This job view page is being replaced by Spyglass soon. Check out the new job view.
PRdependabot[bot]: chore(deps): bump github.com/onsi/gomega from 1.27.1 to 1.27.4
ResultFAILURE
Tests 1 failed / 46 succeeded
Started2023-03-14 18:04
Elapsed2h48m
Revision3806f0e00474f05dd2967152cea4fc919ef8ee80
Refs 3563

Test Failures


Cloud provider Azure e2e suite [It] Service with annotation should support service annotation `service.beta.kubernetes.io/azure-pip-prefix-id` [ServiceAnnotation] 45s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Cloud\sprovider\sAzure\se2e\ssuite\s\[It\]\sService\swith\sannotation\sshould\ssupport\sservice\sannotation\s\`service\.beta\.kubernetes\.io\/azure\-pip\-prefix\-id\`\s\[ServiceAnnotation\]$'
[FAILED] Unexpected error:
    <autorest.DetailedError>: 
    network.PublicIPPrefixesClient#CreateOrUpdate: Failure sending request: StatusCode=400 -- Original Error: Code="StaticPublicIPCountLimitReached" Message="Cannot create more than 100 public IP addresses with static allocation method for this subscription in this region." Details=[]
    {
        Original: <*azure.ServiceError | 0xc0000ad260>{
            Code: "StaticPublicIPCountLimitReached",
            Message: "Cannot create more than 100 public IP addresses with static allocation method for this subscription in this region.",
            Target: nil,
            Details: [],
            InnerError: nil,
            AdditionalInfo: nil,
        },
        PackageType: "network.PublicIPPrefixesClient",
        Method: "CreateOrUpdate",
        StatusCode: <int>400,
        Message: "Failure sending request",
        ServiceError: nil,
        Response: {
            Status: "400 Bad Request",
            StatusCode: 400,
            Proto: "HTTP/2.0",
            ProtoMajor: 2,
            ProtoMinor: 0,
            Header: {
                "Content-Type": [
                    "application/json; charset=utf-8",
                ],
                "X-Ms-Request-Id": [
                    "84897b11-7194-44bd-9579-a9658d720ff6",
                ],
                "X-Ms-Correlation-Request-Id": [
                    "f1f9db13-a775-48f1-ae39-a2375d9c1c22",
                ],
                "Server": [
                    "Microsoft-HTTPAPI/2.0",
                    "Microsoft-HTTPAPI/2.0",
                ],
                "X-Ms-Routing-Request-Id": [
                    "CENTRALUS:20230314T202315Z:f1f9db13-a775-48f1-ae39-a2375d9c1c22",
                ],
                "Cache-Control": ["no-cache"],
                "Content-Length": ["225"],
                "X-Ms-Arm-Service-Request-Id": [
                    "a8702002-2193-4601-bbba-d2d84a51621e",
                ],
                "Strict-Transport-Security": [
                    "max-age=31536000; includeSubDomains",
                ],
                "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["1194"],
                "X-Content-Type-Options": ["nosniff"],
                "Pragma": ["no-cache"],
                "Expires": ["-1"],
                "Date": [
                    "Tue, 14 Mar 2023 20:23:15 GMT",
                ],
            },
            Body: <io.nopCloserWriterTo>{
                Reader: <*bytes.Reader | 0xc000ab4480>{
                    s: [123, 13, 10, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 13, 10, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 83, 116, 97, 116, 105, 99, 80, 117, 98, 108, 105, 99, 73, 80, 67, 111, 117, 110, 116, 76, 105, 109, 105, 116, 82, 101, 97, 99, 104, 101, 100, 34, 44, 13, 10, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 99, 114, 101, 97, 116, 101, 32, 109, 111, 114, 101, 32, 116, 104, 97, 110, 32, 49, 48, 48, 32, 112, 117, 98, 108, 105, 99, 32, 73, 80, 32, 97, 100, 100, 114, 101, 115, 115, 101, 115, 32, 119, 105, 116, 104, 32, 115, 116, 97, 116, 105, 99, 32, 97, 108, 108, 111, 99, 97, 116, 105, 111, 110, 32, 109, 101, 116, 104, 111, 100, 32, 102, 111, 114, 32, 116, 104, 105, 115, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 105, 110, 32, 116, 104, 105, 115, 32, 114, 101, 103, 105, 111, 110, 46, 34, 44, 13, 10, 32, 32, 32, 32, 34, 100, 101, 116, 97, 105, 108, 115, 34, 58, 32, 91, 93, 13, 10, 32, 32, 125, 13, 10, 125],
                    i: 0,
                    prevRune: -1,
                },
            },
            ContentLength: 225,
            TransferEncoding: nil,
            Close: false,
            Uncompressed: false,
            Trailer: nil,
            Request: {
                Method: "PUT",
                URL: {
                    Scheme: "https",
                    Opaque: "",
                    User: nil,
                    Host: "management.azure.com",
                    Path: "/subscriptions/===REDACTED===/resourceGroups/capz-12tq54/providers/Microsoft.Network/publicIPPrefixes/prefix2",
                    RawPath: "",
                    OmitHost: false,
                    ForceQuery: false,
                    RawQuery: "api-version=2022-07-01",
...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
In [It] at: /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:469 @ 03/14/23 20:23:16.379

There were additional failures detected after the initial failure. These are visible in the timeline

				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Show 46 Passed Tests

Show 16 Skipped Tests

Error lines from build-log.txt

... skipping 142 lines ...
https://docs.docker.com/engine/reference/commandline/login/#credentials-store

Login Succeeded
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure
/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure
Image Tag is ebd6c9f
Error response from daemon: manifest for capzci.azurecr.io/azure-cloud-controller-manager:ebd6c9f not found: manifest unknown: manifest tagged by "ebd6c9f" is not found
Build Linux Azure amd64 cloud controller manager
make: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure'
make ARCH=amd64 build-ccm-image
make[1]: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure'
docker buildx inspect img-builder > /dev/null || docker buildx create --name img-builder --use
ERROR: no builder "img-builder" found
img-builder
# enable qemu for arm64 build
# https://github.com/docker/buildx/issues/464#issuecomment-741507760
docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64
Unable to find image 'tonistiigi/binfmt:latest' locally
latest: Pulling from tonistiigi/binfmt
... skipping 1227 lines ...
certificate.cert-manager.io "selfsigned-cert" deleted
# Create secret for AzureClusterIdentity
./hack/create-identity-secret.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
Error from server (NotFound): secrets "cluster-identity-secret" not found
secret/cluster-identity-secret created
secret/cluster-identity-secret labeled
# Create customized cloud provider configs
./hack/create-custom-cloud-provider-config.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
... skipping 143 lines ...
timeout --foreground 600 bash -c "while ! /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 --kubeconfig=./kubeconfig get nodes | grep control-plane; do sleep 1; done"
Unable to connect to the server: dial tcp 20.116.160.122:6443: i/o timeout
capz-12tq54-control-plane-jr5qp   NotReady   control-plane   8s    v1.24.12-rc.0.26+5c76b515b703c0
run "/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 --kubeconfig=./kubeconfig ..." to work with the new target cluster
make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
namespace/calico-system created
Error from server (NotFound): configmaps "kubeadm-config" not found
configmap/kubeadm-config created
Installing Calico CNI via helm
Cluster CIDR is IPv4
WARNING: Kubernetes configuration file is group-readable. This is insecure. Location: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig
WARNING: Kubernetes configuration file is world-readable. This is insecure. Location: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig
Release "calico" does not exist. Installing it now.
... skipping 81 lines ...
  Mar 14 18:31:03.086: INFO: 3 pods in namespace e2e-tests-nsg-2zbmw are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 18:31:13.139: INFO: 0 pods in namespace e2e-tests-nsg-2zbmw are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Creating a service and expose it @ 03/14/23 18:31:13.139
  Mar 14 18:31:13.139: INFO: Creating service nsg-test in namespace e2e-tests-nsg-2zbmw [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 18:31:13.198: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-2zbmw [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 18:31:13.198: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 18:31:13.233: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:31:23.274: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:31:33.267: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:31:43.295: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:31:53.272: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:32:03.274: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:32:13.278: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:32:23.267: INFO: Exposure successfully, get external ip: 20.116.162.73 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 18:32:23.267: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-2zbmw to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 18:32:23.267: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-nsg-2zbmw [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 18:32:23.348: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 18:32:33.387: INFO: checking the connectivity of addr 20.116.162.73:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 18:32:33.388: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 47 lines ...
  Mar 14 18:33:49.561: INFO: 3 pods in namespace e2e-tests-nsg-vbd8b are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 18:33:59.614: INFO: 0 pods in namespace e2e-tests-nsg-vbd8b are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Exposing two services with shared security rule @ 03/14/23 18:33:59.615
  Mar 14 18:33:59.615: INFO: Creating service nsg-test in namespace e2e-tests-nsg-vbd8b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 18:33:59.670: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-vbd8b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 18:33:59.670: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 18:33:59.703: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:34:09.741: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:34:19.742: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:34:29.746: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:34:39.754: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:34:49.746: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:34:59.737: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:35:09.745: INFO: Exposure successfully, get external ip: 20.175.130.118 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 18:35:09.745: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-vbd8b to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 18:35:09.745: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-nsg-vbd8b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 18:35:09.816: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 18:35:19.858: INFO: checking the connectivity of addr 20.175.130.118:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 18:35:19.858: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 2 lines ...
  Mar 14 18:35:20.374: INFO: stdout: "" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:177]
  Mar 14 18:35:20.374: INFO: Validation succeeded: Service addr 20.175.130.118 and port 80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:194]
  Mar 14 18:35:20.436: INFO: Deleting pod exec-agnhost-pod in namespace e2e-tests-nsg-vbd8b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:138]
  Mar 14 18:35:20.470: INFO: Creating service nsg-test-share in namespace e2e-tests-nsg-vbd8b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 18:35:20.526: INFO: Successfully created LoadBalancer service nsg-test-share in namespace e2e-tests-nsg-vbd8b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 18:35:20.526: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 18:35:20.558: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:35:30.597: INFO: Exposure successfully, get external ip: 20.175.131.144 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 18:35:30.598: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-vbd8b to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 18:35:30.598: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-nsg-vbd8b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 18:35:30.666: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 18:35:40.708: INFO: checking the connectivity of addr 20.175.131.144:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 18:35:40.708: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 47 lines ...
  Mar 14 18:37:04.835: INFO: 3 pods in namespace e2e-tests-nsg-pk5l5 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 18:37:14.884: INFO: 0 pods in namespace e2e-tests-nsg-pk5l5 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Creating service and wait it to expose @ 03/14/23 18:37:14.884
  Mar 14 18:37:14.885: INFO: Creating service nsg-test in namespace e2e-tests-nsg-pk5l5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:193]
  Mar 14 18:37:14.935: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-pk5l5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:197]
  STEP: Waiting for the service to be exposed @ 03/14/23 18:37:14.935
  Mar 14 18:37:14.969: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:37:25.011: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:37:35.010: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:37:45.010: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:37:55.013: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:38:05.010: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:38:15.010: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:38:25.011: INFO: Exposure successfully, get external ip: 20.175.132.65 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  STEP: Validating if the corresponding IP prefix existing in nsg @ 03/14/23 18:38:25.011
  Mar 14 18:38:25.011: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:183]
  Mar 14 18:38:25.487: INFO: got sg list, length = 2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:208]
  Mar 14 18:38:25.531: INFO: Deleting namespace e2e-tests-nsg-pk5l5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:134]
• [134.933 seconds]
... skipping 10 lines ...
  Mar 14 18:39:19.587: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:69]
  Mar 14 18:39:19.625: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:74]
  Mar 14 18:39:19.714: INFO: 1 pods in namespace e2e-tests-nsg-xljsp are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 18:39:29.769: INFO: 0 pods in namespace e2e-tests-nsg-xljsp are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Creating a test service with the deny rule annotation but without `service.Spec.LoadBalancerSourceRanges` @ 03/14/23 18:39:29.769
  STEP: Waiting for the service to expose @ 03/14/23 18:39:29.82
  Mar 14 18:39:29.856: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:39:39.898: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:39:49.892: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:39:59.894: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:40:09.898: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:40:19.896: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:40:29.898: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:40:39.900: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 18:40:39.900: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-xljsp to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 18:40:39.900: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-nsg-xljsp [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 18:40:39.983: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 18:40:50.029: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 18:40:50.029: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 11 lines ...
  Mar 14 18:40:51.328: INFO: Deleting service "nsg-test" in namespace "e2e-tests-nsg-xljsp" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:47]
  STEP: Creating a test service with the deny rule annotation and `service.Spec.LoadBalancerSourceRanges` @ 03/14/23 18:41:33.449
  Mar 14 18:41:33.450: INFO: Creating a hostNetwork Pod exec-agnhost-pod-deny-all-except-lb-range in namespace e2e-tests-nsg-xljsp to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 18:41:33.450: INFO: creating pod exec-agnhost-pod-deny-all-except-lb-range in namespace e2e-tests-nsg-xljsp [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 18:41:33.529: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  STEP: Waiting for the service to expose @ 03/14/23 18:41:43.774
  Mar 14 18:41:43.808: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:41:53.841: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:42:03.853: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:42:13.851: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:42:23.843: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:42:33.853: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:42:43.852: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:42:53.852: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 18:42:53.852: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol  [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:277]
  Mar 14 18:42:53.852: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 18:42:53.852: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-nsg-xljsp exec exec-agnhost-pod-deny-all-except-lb-range -- /bin/sh -x -c nc -vz -w 4  10.1.0.6 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 18:42:54.411: INFO: stderr: "+ nc -vz -w 4 10.1.0.6 80\nConnection to 10.1.0.6 80 port [tcp/http] succeeded!\n" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:176]
  Mar 14 18:42:54.411: INFO: stdout: "" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:177]
... skipping 27 lines ...
  Mar 14 18:43:48.851: INFO: 1 pods in namespace e2e-tests-nsg-r84jb are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 18:43:58.897: INFO: 0 pods in namespace e2e-tests-nsg-r84jb are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Creating a public IP with tags @ 03/14/23 18:43:58.897
  Mar 14 18:43:58.897: INFO: Creating public IP resource named nsg-public-IP-disable-floating-ip [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  Mar 14 18:44:02.621: INFO: created pip with address 20.104.97.109 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:301]
  STEP: Creating a test load balancer service with floating IP disabled @ 03/14/23 18:44:02.621
  Mar 14 18:44:02.705: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:44:12.745: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:44:22.747: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:44:32.746: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:44:42.744: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:44:52.746: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:45:02.745: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:45:12.745: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:45:22.740: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:45:32.740: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:45:42.746: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:45:52.739: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:46:02.747: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:46:12.747: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:46:22.746: INFO: Exposure successfully, get external ip: 20.104.97.109 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 18:46:22.746: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-r84jb to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 18:46:22.746: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-nsg-r84jb [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 18:46:22.821: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 18:46:33.699: INFO: checking the connectivity of addr 20.104.97.109:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 18:46:33.699: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 22 lines ...
  Mar 14 18:47:08.017: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 18:47:09.728: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:701]
  STEP: Creating a service and expose it @ 03/14/23 18:47:09.801
  Mar 14 18:47:09.802: INFO: Creating service service-lb-test in namespace e2e-tests-service-lb-678ch [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 18:47:10.258: INFO: Successfully created LoadBalancer service service-lb-test in namespace e2e-tests-service-lb-678ch [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 18:47:10.258: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 18:47:10.489: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:47:20.529: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:47:30.530: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:47:40.525: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:47:50.531: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:48:00.530: INFO: Exposure successfully, get external ip: 20.157.26.61 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 18:48:00.530: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-678ch to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 18:48:00.530: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-678ch [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 18:48:00.604: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 18:48:10.647: INFO: checking the connectivity of addr 20.157.26.61:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 18:48:10.647: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 57 lines ...
  Mar 14 18:49:38.033: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 18:49:38.033: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 18:49:39.749: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:701]
  STEP: Creating a BYO public IP @ 03/14/23 18:49:39.785
  Mar 14 18:49:39.785: INFO: Creating public IP resource named service-lb-public-IPee0a [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  STEP: Creating a service and expose it @ 03/14/23 18:49:43.151
  Mar 14 18:49:43.234: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:49:53.274: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:50:03.269: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:50:13.270: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:50:23.276: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:50:33.276: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:50:43.277: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:50:53.276: INFO: Exposure successfully, get external ip: 20.104.99.20 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 18:50:53.276: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-s8nc2 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 18:50:53.276: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-s8nc2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 18:50:53.371: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 18:51:03.415: INFO: checking the connectivity of addr 20.104.99.20:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 18:51:03.415: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 58 lines ...
  Mar 14 18:52:10.033: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 18:52:10.033: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 18:52:11.772: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:701]
  STEP: Creating a BYO public IP prefix @ 03/14/23 18:52:11.809
  Mar 14 18:52:11.810: INFO: Creating PublicIPPrefix named prefix [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:266]
  STEP: Creating a service and expose it @ 03/14/23 18:52:15.102
  Mar 14 18:52:15.193: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:52:25.236: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:52:35.228: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:52:45.233: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:52:55.237: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:53:05.235: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:53:15.237: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:53:25.228: INFO: Exposure successfully, get external ip: 4.205.79.96 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 18:53:25.228: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-bs585 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 18:53:25.228: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-bs585 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 18:53:25.299: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 18:53:35.344: INFO: checking the connectivity of addr 4.205.79.96:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 18:53:35.344: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 63 lines ...
  STEP: Test subnet doesn't exist. Creating a new one... @ 03/14/23 18:55:00.154
  Mar 14 18:55:02.544: INFO: creating a new subnet testSubnet, 10.2.0.0/24 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:85]
  STEP: Creating a service and expose it @ 03/14/23 18:55:03.225
  Mar 14 18:55:03.226: INFO: Creating service service-lb-test in namespace e2e-tests-service-lb-m85tn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 18:55:03.278: INFO: Successfully created LoadBalancer service service-lb-test in namespace e2e-tests-service-lb-m85tn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 18:55:03.278: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 18:55:03.311: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:55:13.355: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:55:23.351: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:55:33.346: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:55:43.346: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:55:53.354: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:56:03.354: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:56:13.354: INFO: Exposure successfully, get external ip: 10.2.0.4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 18:56:13.354: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-m85tn to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 18:56:13.354: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-m85tn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 18:56:13.425: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 18:56:23.468: INFO: checking the connectivity of addr 10.2.0.4:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 18:56:23.468: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 51 lines ...
  Mar 14 18:57:25.026: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
  Mar 14 18:57:25.076: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 18:57:25.076: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 18:57:26.880: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:93]
  Mar 14 18:57:26.918: INFO: Updating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:112]
  STEP: creating a mixed protocol service @ 03/14/23 18:57:26.96
  Mar 14 18:57:27.126: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:57:37.167: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:57:47.167: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:57:57.162: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:58:07.169: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:58:17.167: INFO: Exposure successfully, get external ip: 20.116.164.62 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 18:58:17.167: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-kqnf4 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 18:58:17.167: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-kqnf4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 18:58:17.243: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 18:58:27.279: INFO: checking the connectivity of addr 20.116.164.62:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 18:58:27.280: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 29 lines ...
  Mar 14 18:59:41.240: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 18:59:43.063: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:93]
  STEP: creating a public IP with tags @ 03/14/23 18:59:43.101
  Mar 14 18:59:43.101: INFO: Creating public IP resource named service-lb-public-IP1545 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  Mar 14 18:59:46.905: INFO: created pip with address 20.220.217.162 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:171]
  STEP: creating a service referencing the public IP @ 03/14/23 18:59:46.906
  Mar 14 18:59:46.988: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 18:59:57.023: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:00:07.026: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:00:17.023: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:00:27.029: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:00:37.026: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:00:47.030: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:00:57.024: INFO: Exposure successfully, get external ip: 20.220.217.162 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:00:57.024: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-98r4n to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:00:57.024: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-98r4n [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:00:57.100: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:01:07.136: INFO: checking the connectivity of addr 20.220.217.162:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:01:07.136: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 22 lines ...
  Mar 14 19:01:41.264: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:01:43.188: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:93]
  Mar 14 19:01:43.319: INFO: Successfully created LoadBalancer service service-lb-test in namespace e2e-tests-service-lb-b8cnt [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:205]
  Mar 14 19:01:43.319: INFO: Creating public IP resource named service-lb-public-none-IP5fc8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  Mar 14 19:01:46.894: INFO: PIP to 20.220.217.162 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:210]
  STEP: Waiting for exposure of the original service without assigned lb IP @ 03/14/23 19:01:46.895
  Mar 14 19:01:46.928: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:01:56.971: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:02:06.970: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:02:16.994: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:02:26.973: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:02:36.970: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:02:46.971: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:02:56.971: INFO: Exposure successfully, get external ip: 20.116.161.185 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:02:56.971: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-b8cnt to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:02:56.971: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-b8cnt [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:02:57.046: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:03:07.084: INFO: checking the connectivity of addr 20.116.161.185:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:03:07.084: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 49 lines ...
  Mar 14 19:06:51.709: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:06:51.709: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:06:53.759: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:93]
  Mar 14 19:06:53.797: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:48]
  Mar 14 19:07:11.982: INFO: Successfully created LoadBalancer service service-lb-test in namespace e2e-tests-service-lb-j5l6b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:248]
  STEP: Waiting for exposure of internal service with specific IP "10.1.0.6" @ 03/14/23 19:07:11.982
  Mar 14 19:07:12.014: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:07:22.053: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:07:32.051: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:07:42.048: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:07:52.057: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:08:02.054: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:08:02.055: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-j5l6b to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:08:02.055: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-j5l6b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:08:02.129: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:08:12.165: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:08:12.165: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 71 lines ...
  Mar 14 19:09:04.005: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:09:04.005: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:09:05.928: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:93]
  Mar 14 19:09:06.097: INFO: Successfully created LoadBalancer service service-lb-test in namespace e2e-tests-service-lb-vtwwz [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:289]
  Mar 14 19:09:06.097: INFO: Creating public IP resource named service-lb-internal-none-public-IPa599 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  STEP: Waiting for exposure of the original service without assigned lb private IP @ 03/14/23 19:09:10.032
  Mar 14 19:09:10.065: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:09:20.101: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:09:30.108: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:09:40.099: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:09:50.104: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:10:00.109: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:10:10.100: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:10:10.100: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-vtwwz to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:10:10.100: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-vtwwz [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:10:10.174: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:10:20.218: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:10:20.218: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 78 lines ...
  Mar 14 19:12:14.583: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:12:16.463: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:93]
  Mar 14 19:12:16.501: INFO: Creating public IP resource named service-lb-public-remain-98ca [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  Mar 14 19:12:20.061: INFO: Creating Service "service-lb-test-0" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:417]
  Mar 14 19:12:20.120: INFO: Creating deployment "deployment-lb-test-1" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:403]
  Mar 14 19:12:20.156: INFO: Creating Service "service-lb-test-1" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:417]
  Mar 14 19:12:20.299: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:12:30.342: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:12:40.332: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:12:50.337: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:13:00.342: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:13:10.342: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:13:20.337: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:13:30.345: INFO: Exposure successfully, get external ip: 20.104.218.49 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:13:30.345: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-bqkgz to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:13:30.345: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-bqkgz [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:13:30.419: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:13:40.463: INFO: checking the connectivity of addr 20.104.218.49:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:13:40.463: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 28 lines ...
  Mar 14 19:14:32.704: INFO: Created a test namespace "e2e-tests-service-lb-x4tsm" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:109]
  Mar 14 19:14:32.704: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
  Mar 14 19:14:32.704: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
  Mar 14 19:14:32.751: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:14:32.751: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:14:34.713: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:93]
  Mar 14 19:14:34.915: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:14:44.956: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:14:54.951: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:15:04.956: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:15:14.959: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:15:24.953: INFO: Exposure successfully, get external ip: 20.200.82.238 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:15:24.954: INFO: Creating deployment deployment-lb-test-1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:451]
  Mar 14 19:15:25.137: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:15:35.173: INFO: Exposure successfully, get external ip: 20.200.82.238 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:15:35.205: INFO: Exposure successfully, get external ip: 20.200.82.238 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:15:35.205: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-x4tsm to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:15:35.205: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-x4tsm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:15:35.283: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:15:45.327: INFO: checking the connectivity of addr 20.200.82.238:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
... skipping 42 lines ...
  Mar 14 19:17:18.490: INFO: Created a test namespace "e2e-tests-service-lb-8p7pb" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:109]
  Mar 14 19:17:18.490: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
  Mar 14 19:17:18.490: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
  Mar 14 19:17:18.540: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:17:18.540: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:17:20.611: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:93]
  Mar 14 19:17:20.791: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:17:30.833: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:17:40.833: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:17:50.826: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:18:00.832: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:18:10.835: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:18:10.835: INFO: Creating deployment deployment-lb-test-1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:538]
  Mar 14 19:18:11.005: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:18:21.046: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:18:21.079: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:18:21.079: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-8p7pb to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:18:21.079: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-8p7pb [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:18:21.157: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:18:31.193: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
... skipping 52 lines ...
  Mar 14 19:21:45.431: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:21:47.760: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:93]
  STEP: creating a public IP with tags @ 03/14/23 19:21:47.798
  Mar 14 19:21:47.798: INFO: Creating public IP resource named service-lb-public-IP7d28 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  Mar 14 19:21:51.534: INFO: created pip with address 20.104.75.126 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:633]
  STEP: creating a service referencing the public IP @ 03/14/23 19:21:51.534
  Mar 14 19:21:51.660: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:22:01.702: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:22:11.706: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:22:21.703: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:22:31.701: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:22:41.701: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:22:51.694: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:23:01.694: INFO: Exposure successfully, get external ip: 20.104.75.126 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:23:01.694: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-pnd2q to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:23:01.694: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-pnd2q [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:23:01.769: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:23:11.806: INFO: checking the connectivity of addr 20.104.75.126:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:23:11.806: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 31 lines ...
  Mar 14 19:23:46.008: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:23:46.008: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:23:48.219: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:76]
  Mar 14 19:23:48.256: INFO: Creating service pls-test in namespace e2e-tests-pls-kzrmx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 19:23:48.332: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-kzrmx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 19:23:48.332: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 19:23:48.376: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:23:58.414: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:24:08.418: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:24:18.415: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:24:28.419: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:24:38.420: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:24:48.416: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:24:58.418: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:25:08.419: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:25:08.419: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-pls-kzrmx to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:25:08.419: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-pls-kzrmx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:25:08.494: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:25:18.535: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:25:18.535: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 23 lines ...
  Mar 14 19:26:38.505: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:26:38.505: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:26:40.574: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:76]
  Mar 14 19:26:40.616: INFO: Creating service pls-test in namespace e2e-tests-pls-g8snp [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 19:26:40.835: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-g8snp [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 19:26:40.835: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 19:26:40.939: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:26:50.973: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:27:00.982: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:27:10.982: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:27:20.981: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:27:30.983: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:27:40.983: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:27:50.982: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:28:00.985: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:28:00.985: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-pls-g8snp to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:28:00.985: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-pls-g8snp [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:28:01.061: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:28:11.104: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:28:11.104: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 26 lines ...
  Mar 14 19:29:13.135: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:48]
  STEP: Test subnet doesn't exist. Creating a new one... @ 03/14/23 19:29:13.442
  Mar 14 19:29:15.532: INFO: creating a new subnet pls-subnet, 10.2.0.0/24 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:85]
  Mar 14 19:29:16.146: INFO: Creating service pls-test in namespace e2e-tests-pls-fjzw9 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 19:29:16.194: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-fjzw9 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 19:29:16.195: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 19:29:16.227: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:29:26.271: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:29:36.270: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:29:46.262: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:29:56.271: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:30:06.270: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:30:16.271: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:30:26.271: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:30:36.270: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:30:46.261: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:30:46.261: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-pls-fjzw9 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:30:46.261: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-pls-fjzw9 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:30:46.335: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:30:56.381: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:30:56.381: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 26 lines ...
  Mar 14 19:31:56.712: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:31:56.712: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:31:58.780: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:76]
  Mar 14 19:31:58.817: INFO: Creating service pls-test in namespace e2e-tests-pls-64tcv [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 19:31:58.914: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-64tcv [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 19:31:58.914: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 19:31:58.947: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:32:08.991: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:32:18.990: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:32:28.992: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:32:38.986: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:32:48.991: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:32:58.983: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:33:08.992: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:33:18.984: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:33:28.990: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:33:28.991: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-pls-64tcv to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:33:28.991: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-pls-64tcv [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:33:29.065: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:33:39.103: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:33:39.104: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 23 lines ...
  Mar 14 19:34:38.948: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:34:38.948: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:34:41.099: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:76]
  Mar 14 19:34:41.137: INFO: Creating service pls-test in namespace e2e-tests-pls-ll2lx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 19:34:41.220: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-ll2lx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 19:34:41.220: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 19:34:41.255: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:34:51.298: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:35:01.299: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:35:11.292: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:35:21.295: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:35:31.299: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:35:41.289: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:35:41.289: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-pls-ll2lx to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:35:41.289: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-pls-ll2lx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:35:41.367: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:35:51.413: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:35:51.413: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 37 lines ...
  Mar 14 19:37:06.181: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:37:06.181: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:37:08.347: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:76]
  Mar 14 19:37:08.384: INFO: Creating service pls-test in namespace e2e-tests-pls-8ksnv [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 19:37:08.468: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-8ksnv [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 19:37:08.468: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 19:37:08.521: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:37:18.556: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:37:28.557: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:37:38.554: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:37:48.557: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:37:58.566: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:38:08.555: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:38:18.559: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:38:28.566: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:38:38.560: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:38:38.560: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-pls-8ksnv to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:38:38.560: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-pls-8ksnv [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:38:38.636: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:38:48.680: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:38:48.681: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 23 lines ...
  Mar 14 19:39:48.460: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:39:48.460: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:39:50.595: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:76]
  Mar 14 19:39:50.632: INFO: Creating service pls-test in namespace e2e-tests-pls-2498m [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 19:39:50.711: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-2498m [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 19:39:50.711: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 19:39:50.745: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:40:00.785: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:40:10.788: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:40:20.781: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:40:30.786: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:40:40.791: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:40:50.788: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:41:00.786: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:41:10.786: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:41:20.790: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:41:20.791: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-pls-2498m to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:41:20.791: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-pls-2498m [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:41:20.867: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:41:30.904: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:41:30.904: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 23 lines ...
  Mar 14 19:42:30.816: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:42:30.816: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:42:33.222: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:76]
  Mar 14 19:42:33.262: INFO: Creating service pls-test in namespace e2e-tests-pls-btgcb [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 19:42:33.355: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-btgcb [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 19:42:33.355: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 19:42:33.411: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:42:43.455: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:42:53.449: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:43:03.444: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:43:13.453: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:43:23.455: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:43:33.452: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:43:43.449: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:43:53.446: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:44:03.445: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:44:03.445: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-pls-btgcb to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:44:03.445: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-pls-btgcb [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:44:03.522: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:44:13.559: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:44:13.559: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 23 lines ...
  Mar 14 19:45:23.547: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:45:23.547: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:45:26.392: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:76]
  Mar 14 19:45:26.430: INFO: Creating service pls-test in namespace e2e-tests-pls-hwhb6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 19:45:26.534: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-hwhb6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 19:45:26.534: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 19:45:26.570: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:45:36.613: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:45:46.605: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:45:56.611: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:46:06.612: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:46:16.606: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:46:26.613: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:46:36.613: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:46:46.607: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:46:56.608: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:47:06.610: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:47:16.605: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:47:26.606: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:47:26.606: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-pls-hwhb6 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:47:26.606: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-pls-hwhb6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:47:26.681: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:47:36.716: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:47:36.716: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 23 lines ...
  Mar 14 19:48:58.529: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:48:58.529: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:49:00.690: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:76]
  Mar 14 19:49:00.729: INFO: Creating service service1 in namespace e2e-tests-pls-vx79c [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 19:49:00.809: INFO: Successfully created LoadBalancer service service1 in namespace e2e-tests-pls-vx79c [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 19:49:00.809: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 19:49:00.855: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:49:10.891: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:49:20.898: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:49:30.889: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:49:40.889: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:49:50.889: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:50:00.904: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:50:10.895: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:50:20.894: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:50:20.894: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-pls-vx79c to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:50:20.894: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-pls-vx79c [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:50:20.968: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:50:31.012: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:50:31.012: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 19:50:31.012: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-pls-vx79c exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  10.1.0.6 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 19:50:31.547: INFO: stderr: "+ nc -vz -w 4 10.1.0.6 80\nConnection to 10.1.0.6 80 port [tcp/http] succeeded!\n" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:176]
  Mar 14 19:50:31.547: INFO: stdout: "" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:177]
  Mar 14 19:50:31.547: INFO: Validation succeeded: Service addr 10.1.0.6 and port 80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:194]
  Mar 14 19:50:31.591: INFO: Deleting pod exec-agnhost-pod in namespace e2e-tests-pls-vx79c [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:138]
  Mar 14 19:50:31.624: INFO: Successfully created service1 in namespace e2e-tests-pls-vx79c with IP 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:374]
  Mar 14 19:50:31.624: INFO: Creating deployment pls-deploy0 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:377]
  Mar 14 19:50:31.767: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:50:41.803: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:50:51.804: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:51:01.802: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 19:51:11.809: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 19:51:11.809: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-pls-vx79c to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 19:51:11.809: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-pls-vx79c [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 19:51:11.883: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 19:51:21.919: INFO: checking the connectivity of addr 10.1.0.6:81 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 19:51:21.919: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 51 lines ...
  Mar 14 20:00:20.787: INFO: 3 pods in namespace e2e-tests-service-6w49b are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:00:30.838: INFO: 0 pods in namespace e2e-tests-service-6w49b are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Create a Service with managed PIP @ 03/14/23 20:00:30.838
  Mar 14 20:00:30.838: INFO: Creating service annotation-test in namespace e2e-tests-service-6w49b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 20:00:30.891: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-6w49b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 20:00:30.891: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 20:00:30.925: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:00:40.968: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:00:50.959: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:01:00.966: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:01:10.967: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:01:20.967: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:01:30.959: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:01:40.971: INFO: Exposure successfully, get external ip: 20.175.128.210 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:01:40.971: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-6w49b to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:01:40.971: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-6w49b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:01:41.048: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:01:51.085: INFO: checking the connectivity of addr 20.175.128.210:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:01:51.086: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 15 lines ...
  STEP: Delete the Service @ 03/14/23 20:02:02.357
  Mar 14 20:02:02.357: INFO: Deleting service "annotation-test" in namespace "e2e-tests-service-6w49b" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:47]
  STEP: Create a PIP @ 03/14/23 20:02:48.463
  Mar 14 20:02:48.463: INFO: Creating public IP resource named service-public-IP-bd2e [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  Mar 14 20:02:52.124: INFO: PIP "service-public-IP-bd2e" to "20.220.228.113" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:170]
  STEP: Create a Service which will be deleted with the PIP @ 03/14/23 20:02:52.124
  Mar 14 20:02:52.222: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:03:02.262: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:03:12.265: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:03:22.259: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:03:32.256: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:03:42.265: INFO: Exposure successfully, get external ip: 20.220.228.113 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:03:42.265: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-6w49b to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:03:42.265: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-6w49b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:03:42.338: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:03:52.376: INFO: checking the connectivity of addr 20.220.228.113:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:03:52.377: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 8 lines ...
  STEP: Create a different Service with the same azure-dns-label-name tag @ 03/14/23 20:04:39.388
  Mar 14 20:04:39.442: INFO: Get domain name: annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:70]
  STEP: Validating External domain name "annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com" @ 03/14/23 20:04:39.442
  Mar 14 20:04:39.442: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 20:04:39.442: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 20:04:43.981: INFO: rc: 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:164]
  Mar 14 20:04:43.981: INFO: got error error running /usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80:
  Command stdout:

  stderr:
  + nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1

  error:
  exit status 1, will retry, output: stdout:
  stderr:+ nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1
   [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:187]
  Mar 14 20:04:53.991: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 20:04:53.991: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 20:04:58.544: INFO: rc: 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:164]
  Mar 14 20:04:58.544: INFO: got error error running /usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80:
  Command stdout:

  stderr:
  + nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1

  error:
  exit status 1, will retry, output: stdout:
  stderr:+ nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1
   [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:187]
  Mar 14 20:05:03.987: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 20:05:03.987: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 20:05:08.558: INFO: rc: 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:164]
  Mar 14 20:05:08.558: INFO: got error error running /usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80:
  Command stdout:

  stderr:
  + nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1

  error:
  exit status 1, will retry, output: stdout:
  stderr:+ nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1
   [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:187]
  Mar 14 20:05:13.982: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 20:05:13.983: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 20:05:18.540: INFO: rc: 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:164]
  Mar 14 20:05:18.540: INFO: got error error running /usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80:
  Command stdout:

  stderr:
  + nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1

  error:
  exit status 1, will retry, output: stdout:
  stderr:+ nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1
   [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:187]
  Mar 14 20:05:23.985: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 20:05:23.985: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 20:05:28.509: INFO: rc: 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:164]
  Mar 14 20:05:28.509: INFO: got error error running /usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80:
  Command stdout:

  stderr:
  + nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1

  error:
  exit status 1, will retry, output: stdout:
  stderr:+ nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1
   [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:187]
  Mar 14 20:05:33.986: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 20:05:33.987: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 20:05:38.528: INFO: rc: 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:164]
  Mar 14 20:05:38.528: INFO: got error error running /usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6w49b exec exec-agnhost-pod-azure-dns-label-name -- /bin/sh -x -c nc -vz -w 4  annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80:
  Command stdout:

  stderr:
  + nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1

  error:
  exit status 1, will retry, output: stdout:
  stderr:+ nc -vz -w 4 annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com 80
  nc: connect to annotation-test-c632d8c5-3339-4ef9-9b91-86be78e33008.canadacentral.cloudapp.azure.com port 80 (tcp) timed out: Operation in progress
  command terminated with exit code 1
   [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:187]
  Mar 14 20:05:43.986: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 36 lines ...
  Mar 14 20:06:49.005: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:94]
  Mar 14 20:06:49.045: INFO: 1 pods in namespace e2e-tests-service-t52xg are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:06:59.099: INFO: 0 pods in namespace e2e-tests-service-t52xg are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:06:59.099: INFO: Creating service annotation-test in namespace e2e-tests-service-t52xg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 20:06:59.157: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-t52xg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 20:06:59.157: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 20:06:59.192: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:07:09.235: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:07:19.229: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:07:29.235: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:07:39.235: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:07:49.235: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:07:59.236: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:08:09.235: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:08:09.235: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-t52xg to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:08:09.235: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-t52xg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:08:09.310: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:08:19.345: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:08:19.345: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 26 lines ...
  STEP: Test subnet doesn't exist. Creating a new one... @ 03/14/23 20:09:01.268
  STEP: Creating a subnet "10.2.0.0/24" @ 03/14/23 20:09:03.58
  Mar 14 20:09:03.580: INFO: creating a new subnet a--------------------------------------------------z, 10.2.0.0/24 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:85]
  Mar 14 20:09:03.912: INFO: Creating service annotation-test in namespace e2e-tests-service-xzs8f [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 20:09:03.962: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-xzs8f [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 20:09:03.962: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 20:09:03.994: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:09:14.030: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:09:24.035: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:09:34.036: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:09:44.029: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:09:54.029: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:10:04.037: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:10:14.029: INFO: Exposure successfully, get external ip: 10.2.0.4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:10:14.029: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-xzs8f to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:10:14.029: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-xzs8f [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:10:14.103: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:10:24.146: INFO: checking the connectivity of addr 10.2.0.4:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:10:24.146: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 25 lines ...
  Mar 14 20:11:16.058: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:94]
  Mar 14 20:11:16.109: INFO: 3 pods in namespace e2e-tests-service-c2fbx are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:11:26.161: INFO: 0 pods in namespace e2e-tests-service-c2fbx are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:11:26.161: INFO: Creating service annotation-test in namespace e2e-tests-service-c2fbx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 20:11:26.217: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-c2fbx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 20:11:26.217: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 20:11:26.252: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:11:36.289: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:11:46.294: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:11:56.286: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:12:06.286: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:12:16.297: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:12:26.295: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:12:36.287: INFO: Exposure successfully, get external ip: 20.116.240.35 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:12:36.287: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-c2fbx to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:12:36.287: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-c2fbx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:12:36.365: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:12:46.401: INFO: checking the connectivity of addr 20.116.240.35:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:12:46.401: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 29 lines ...
  STEP: resource group e2e-bb23 created @ 03/14/23 20:14:16.712
  STEP: creating test PIP in the test resource group @ 03/14/23 20:14:16.712
  Mar 14 20:14:16.712: INFO: Creating public IP resource named testPIP-650c [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  STEP: Creating service annotation-test in namespace e2e-tests-service-sgtkl @ 03/14/23 20:14:20.017
  Mar 14 20:14:20.070: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-sgtkl [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:359]
  STEP: Waiting service to expose... @ 03/14/23 20:14:20.07
  Mar 14 20:14:20.105: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:14:30.140: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:14:40.144: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:14:50.141: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:15:00.149: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:15:10.146: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:15:20.146: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:15:30.149: INFO: Exposure successfully, get external ip: 20.220.165.18 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:15:30.149: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-sgtkl to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:15:30.149: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-sgtkl [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:15:30.219: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:15:40.280: INFO: checking the connectivity of addr 20.220.165.18:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:15:40.280: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 29 lines ...
  Mar 14 20:16:51.391: INFO: Creating deployment annotation-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:89]
  Mar 14 20:16:51.430: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:94]
  Mar 14 20:16:51.481: INFO: 3 pods in namespace e2e-tests-service-pqvx5 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:17:01.533: INFO: 0 pods in namespace e2e-tests-service-pqvx5 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Creating a service with custom tags @ 03/14/23 20:17:01.533
  STEP: Waiting service to expose... @ 03/14/23 20:17:01.582
  Mar 14 20:17:01.615: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:17:11.656: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:17:21.650: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:17:31.654: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:17:41.659: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:17:51.660: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:18:01.659: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:18:11.649: INFO: Exposure successfully, get external ip: 20.116.167.115 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:18:11.649: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-pqvx5 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:18:11.649: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-pqvx5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:18:11.726: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:18:21.761: INFO: checking the connectivity of addr 20.116.167.115:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:18:21.761: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 54 lines ...
  Mar 14 20:20:15.983: INFO: 0 pods in namespace e2e-tests-service-skdvg are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Creating two test pips @ 03/14/23 20:20:15.983
  Mar 14 20:20:15.983: INFO: Creating public IP resource named pip1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  Mar 14 20:20:19.839: INFO: Creating public IP resource named pip2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  STEP: Creating a service referring to the first pip @ 03/14/23 20:20:23.393
  STEP: Waiting for the service to expose @ 03/14/23 20:20:23.442
  Mar 14 20:20:23.476: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:20:33.518: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:20:43.519: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:20:53.510: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:21:03.518: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:21:13.517: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:21:23.518: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:21:33.516: INFO: Exposure successfully, get external ip: 20.220.207.189 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:21:33.516: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-skdvg to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:21:33.516: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-skdvg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:21:33.591: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:21:43.626: INFO: checking the connectivity of addr 20.220.207.189:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:21:43.626: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 43 lines ...
  Mar 14 20:22:48.601: INFO: Creating PublicIPPrefix named prefix1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:266]
  Mar 14 20:22:52.244: INFO: Creating PublicIPPrefix named prefix2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:266]
  STEP: Cleaning up pip-prefix: prefix2 @ 03/14/23 20:22:53.048
  Mar 14 20:22:53.049: INFO: Deleting PublicIPPrefix named prefix2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:348]
  STEP: Cleaning up pip-prefix: prefix1 @ 03/14/23 20:22:53.196
  Mar 14 20:22:53.196: INFO: Deleting PublicIPPrefix named prefix1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:348]
  [FAILED] in [It] - /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:469 @ 03/14/23 20:22:53.563
  Mar 14 20:22:53.600: INFO: Deleting namespace e2e-tests-service-8j7z8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:134]

  Attempt #1 Failed.  Retrying ↺ @ 03/14/23 20:22:59.708

  Mar 14 20:22:59.708: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
  Mar 14 20:22:59.708: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
  Mar 14 20:22:59.746: INFO: Created a test namespace "e2e-tests-service-qk9qw" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:109]
  Mar 14 20:22:59.746: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:85]
  Mar 14 20:22:59.746: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
... skipping 8 lines ...
  Mar 14 20:23:11.587: INFO: Creating PublicIPPrefix named prefix1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:266]
  Mar 14 20:23:15.105: INFO: Creating PublicIPPrefix named prefix2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:266]
  STEP: Cleaning up pip-prefix: prefix2 @ 03/14/23 20:23:15.935
  Mar 14 20:23:15.935: INFO: Deleting PublicIPPrefix named prefix2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:348]
  STEP: Cleaning up pip-prefix: prefix1 @ 03/14/23 20:23:16.038
  Mar 14 20:23:16.038: INFO: Deleting PublicIPPrefix named prefix1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:348]
  [FAILED] in [It] - /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:469 @ 03/14/23 20:23:16.379
  Mar 14 20:23:16.415: INFO: Deleting namespace e2e-tests-service-qk9qw [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:134]
• [FAILED] [45.864 seconds]
Service with annotation [It] should support service annotation `service.beta.kubernetes.io/azure-pip-prefix-id` [ServiceAnnotation]
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:447

  [FAILED] Unexpected error:
      <autorest.DetailedError>: 
      network.PublicIPPrefixesClient#CreateOrUpdate: Failure sending request: StatusCode=400 -- Original Error: Code="StaticPublicIPCountLimitReached" Message="Cannot create more than 100 public IP addresses with static allocation method for this subscription in this region." Details=[]
      {
          Original: <*azure.ServiceError | 0xc0000ad260>{
              Code: "StaticPublicIPCountLimitReached",
              Message: "Cannot create more than 100 public IP addresses with static allocation method for this subscription in this region.",
              Target: nil,
              Details: [],
... skipping 96 lines ...
  Mar 14 20:23:24.350: INFO: 3 pods in namespace e2e-tests-service-7qzlx are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:23:34.395: INFO: 0 pods in namespace e2e-tests-service-7qzlx are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Creating a service with health probe annotations @ 03/14/23 20:23:34.396
  Mar 14 20:23:34.396: INFO: Creating service annotation-test in namespace e2e-tests-service-7qzlx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 20:23:34.442: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-7qzlx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 20:23:34.442: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 20:23:34.475: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:23:44.509: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:23:54.508: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:24:04.510: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:24:14.509: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:24:24.517: INFO: Exposure successfully, get external ip: 20.116.167.211 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:24:24.518: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-7qzlx to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:24:24.518: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-7qzlx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:24:24.593: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:24:34.635: INFO: checking the connectivity of addr 20.116.167.211:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:24:34.635: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 33 lines ...
  Mar 14 20:25:30.176: INFO: 1 pods in namespace e2e-tests-service-bq9cw are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:25:40.219: INFO: 0 pods in namespace e2e-tests-service-bq9cw are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Creating a service with health probe annotations @ 03/14/23 20:25:40.219
  Mar 14 20:25:40.220: INFO: Creating service annotation-test in namespace e2e-tests-service-bq9cw [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 20:25:40.286: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-bq9cw [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 20:25:40.286: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 20:25:40.319: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:25:50.362: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:26:00.355: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:26:10.353: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:26:20.363: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:26:30.361: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:26:40.362: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:26:50.363: INFO: Exposure successfully, get external ip: 20.116.240.61 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:26:50.363: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-bq9cw to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:26:50.363: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-bq9cw [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:26:50.437: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:27:00.474: INFO: checking the connectivity of addr 20.116.240.61:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:27:00.474: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 33 lines ...
  Mar 14 20:27:46.261: INFO: 3 pods in namespace e2e-tests-service-t245w are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:27:56.313: INFO: 0 pods in namespace e2e-tests-service-t245w are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Creating a service with health probe annotations @ 03/14/23 20:27:56.313
  Mar 14 20:27:56.313: INFO: Creating service annotation-test in namespace e2e-tests-service-t245w [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 20:27:56.379: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-t245w [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 20:27:56.380: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 20:27:56.413: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:28:06.447: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:28:16.453: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:28:26.448: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:28:36.449: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:28:46.448: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:28:56.457: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:29:06.460: INFO: Exposure successfully, get external ip: 20.116.163.148 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:29:06.460: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-t245w to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:29:06.460: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-t245w [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:29:06.534: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:29:16.570: INFO: checking the connectivity of addr 20.116.163.148:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:29:16.570: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 24 lines ...
  Mar 14 20:29:18.767: INFO: Validating health probe config protocol [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:672]
  STEP: Cleaning up service @ 03/14/23 20:29:18.767
  Mar 14 20:29:18.767: INFO: Deleting service "annotation-test" in namespace "e2e-tests-service-t245w" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:47]
  Mar 14 20:30:04.913: INFO: Deleting namespace e2e-tests-service-t245w [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:134]
• [146.683 seconds]
------------------------------
Service with annotation should return error with invalid health probe config [ServiceAnnotation]
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:677
  Mar 14 20:30:11.023: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
  Mar 14 20:30:11.023: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
  Mar 14 20:30:11.061: INFO: Created a test namespace "e2e-tests-service-pxfcw" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:109]
  Mar 14 20:30:11.061: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:85]
  Mar 14 20:30:11.061: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
... skipping 2 lines ...
  Mar 14 20:30:11.107: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 20:30:13.000: INFO: Creating deployment annotation-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:89]
  Mar 14 20:30:13.040: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:94]
  Mar 14 20:30:13.085: INFO: 2 pods in namespace e2e-tests-service-pxfcw are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:30:23.137: INFO: 0 pods in namespace e2e-tests-service-pxfcw are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  STEP: Creating a service with health probe annotations @ 03/14/23 20:30:23.137
  STEP: Check if correct error message are presented @ 03/14/23 20:30:23.193
  Mar 14 20:30:23.193: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 20:30:23.193: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-pxfcw describe service annotation-test' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 20:30:23.515: INFO: stderr: "" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:176]
  Mar 14 20:30:23.515: INFO: stdout: "Name:                     annotation-test\nNamespace:                e2e-tests-service-pxfcw\nLabels:                   <none>\nAnnotations:              service.beta.kubernetes.io/port_80_health-probe_port: 65536\nSelector:                 app=annotation-test\nType:                     LoadBalancer\nIP Family Policy:         PreferDualStack\nIP Families:              IPv4\nIP:                       10.96.231.29\nIPs:                      10.96.231.29\nPort:                     http  80/TCP\nTargetPort:               80/TCP\nNodePort:                 http  30813/TCP\nEndpoints:                192.168.120.224:80,192.168.120.225:80,192.168.249.78:80 + 2 more...\nSession Affinity:         None\nExternal Traffic Policy:  Cluster\nEvents:\n  Type    Reason                Age   From                Message\n  ----    ------                ----  ----                -------\n  Normal  EnsuringLoadBalancer  0s    service-controller  Ensuring load balancer\n" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:177]
  Mar 14 20:30:24.516: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 20:30:24.516: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-pxfcw describe service annotation-test' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 20:30:24.832: INFO: stderr: "" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:176]
  Mar 14 20:30:24.832: INFO: stdout: "Name:                     annotation-test\nNamespace:                e2e-tests-service-pxfcw\nLabels:                   <none>\nAnnotations:              service.beta.kubernetes.io/port_80_health-probe_port: 65536\nSelector:                 app=annotation-test\nType:                     LoadBalancer\nIP Family Policy:         PreferDualStack\nIP Families:              IPv4\nIP:                       10.96.231.29\nIPs:                      10.96.231.29\nPort:                     http  80/TCP\nTargetPort:               80/TCP\nNodePort:                 http  30813/TCP\nEndpoints:                192.168.120.224:80,192.168.120.225:80,192.168.249.78:80 + 2 more...\nSession Affinity:         None\nExternal Traffic Policy:  Cluster\nEvents:\n  Type    Reason                Age   From                Message\n  ----    ------                ----  ----                -------\n  Normal  EnsuringLoadBalancer  1s    service-controller  Ensuring load balancer\n" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:177]
  Mar 14 20:30:25.516: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 20:30:25.516: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-pxfcw describe service annotation-test' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  Mar 14 20:30:25.849: INFO: stderr: "" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:176]
  Mar 14 20:30:25.849: INFO: stdout: "Name:                     annotation-test\nNamespace:                e2e-tests-service-pxfcw\nLabels:                   <none>\nAnnotations:              service.beta.kubernetes.io/port_80_health-probe_port: 65536\nSelector:                 app=annotation-test\nType:                     LoadBalancer\nIP Family Policy:         PreferDualStack\nIP Families:              IPv4\nIP:                       10.96.231.29\nIPs:                      10.96.231.29\nPort:                     http  80/TCP\nTargetPort:               80/TCP\nNodePort:                 http  30813/TCP\nEndpoints:                192.168.120.224:80,192.168.120.225:80,192.168.249.78:80 + 2 more...\nSession Affinity:         None\nExternal Traffic Policy:  Cluster\nEvents:\n  Type     Reason                  Age   From                Message\n  ----     ------                  ----  ----                -------\n  Normal   EnsuringLoadBalancer    2s    service-controller  Ensuring load balancer\n  Warning  SyncLoadBalancerFailed  0s    service-controller  Error syncing load balancer: failed to ensure load balancer: failed to parse annotation service.beta.kubernetes.io/port_80_health-probe_port: port 65536 is out of range\n" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:177]
  STEP: Cleaning up Service @ 03/14/23 20:30:25.849
  Mar 14 20:30:25.849: INFO: Deleting service "annotation-test" in namespace "e2e-tests-service-pxfcw" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:47]
  Mar 14 20:30:37.993: INFO: Deleting namespace e2e-tests-service-pxfcw [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:134]
• [33.098 seconds]
------------------------------
Service with annotation should support service annotation 'service.beta.kubernetes.io/azure-load-balancer-ip' [ServiceAnnotation]
... skipping 14 lines ...
  Mar 14 20:30:56.149: INFO: Creating public IP resource named service-public-IP81a7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:241]
  Mar 14 20:31:00.121: INFO: Created pip with address 20.220.203.18 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:724]
  STEP: Creating a Service @ 03/14/23 20:31:00.121
  Mar 14 20:31:00.121: INFO: Creating service annotation-test in namespace e2e-tests-service-6ww8n [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 20:31:00.169: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-6ww8n [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 20:31:00.169: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 20:31:00.202: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:31:10.244: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:31:20.245: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:31:30.246: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:31:40.236: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:31:50.245: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:32:00.241: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:32:10.245: INFO: Exposure successfully, get external ip: 20.220.203.18 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:32:10.245: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-6ww8n to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:32:10.245: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-6ww8n [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:32:10.320: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:32:20.362: INFO: checking the connectivity of addr 20.220.203.18:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:32:20.362: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 85 lines ...
  Mar 14 20:33:40.282: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/standard_lb.go:70]
  Mar 14 20:33:40.320: INFO: 1 pods in namespace e2e-tests-service-lb-jtl8q are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:33:50.363: INFO: 0 pods in namespace e2e-tests-service-lb-jtl8q are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:33:50.364: INFO: Creating service servicelb-test in namespace e2e-tests-service-lb-jtl8q [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 20:33:50.412: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-jtl8q [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 20:33:50.412: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 20:33:50.445: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:34:00.489: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:34:10.479: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:34:20.490: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:34:30.483: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:34:40.488: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:34:50.488: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:35:00.482: INFO: Exposure successfully, get external ip: 20.116.245.206 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:35:00.482: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-jtl8q to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:35:00.482: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-jtl8q [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:35:00.562: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:35:10.606: INFO: checking the connectivity of addr 20.116.245.206:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:35:10.606: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 28 lines ...
  Mar 14 20:36:22.428: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/standard_lb.go:70]
  Mar 14 20:36:22.471: INFO: 1 pods in namespace e2e-tests-service-lb-lpvtk are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:36:32.521: INFO: 0 pods in namespace e2e-tests-service-lb-lpvtk are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87]
  Mar 14 20:36:32.521: INFO: Creating service servicelb-test in namespace e2e-tests-service-lb-lpvtk [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1093]
  Mar 14 20:36:32.578: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-lpvtk [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1097]
  Mar 14 20:36:32.578: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1100]
  Mar 14 20:36:32.610: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:36:42.644: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:36:52.644: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:37:02.645: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:37:12.644: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:37:22.647: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:37:32.645: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:37:42.654: INFO: Exposure successfully, get external ip: 20.175.133.20 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:37:42.654: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-lpvtk to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:37:42.654: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-lpvtk [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:37:42.726: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:37:52.770: INFO: checking the connectivity of addr 20.175.133.20:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:37:52.770: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 14 lines ...
[StandardLoadBalancer] Standard load balancer [It] should make outbound IP of pod same as in SLB's outbound rules [SLBOutbound]
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/standard_lb.go:166

  [SKIPPED] skip validating outbound IPs since outbound rules are not configured on SLB
  In [It] at: /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/standard_lb.go:198 @ 03/14/23 20:37:54.51
------------------------------
Multi-ports service When ExternalTrafficPolicy is updated Should not have error occurred [Multi-Ports]
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:893
  Mar 14 20:39:02.665: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
  Mar 14 20:39:02.665: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
  Mar 14 20:39:02.710: INFO: Created a test namespace "e2e-tests-mpservice-8tqc4" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:109]
  Mar 14 20:39:02.710: INFO: Creating deployment multiport-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:866]
  Mar 14 20:39:02.752: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:871]
... skipping 5 lines ...
  Mar 14 20:39:12.904: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
  Mar 14 20:39:12.904: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig cluster-info dump | grep service-cluster-ip-range' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149]
  STEP: Getting the service @ 03/14/23 20:39:14.758
  Mar 14 20:39:14.758: INFO: Creating service multiport-test in namespace e2e-tests-mpservice-8tqc4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:896]
  Mar 14 20:39:14.811: INFO: Successfully created LoadBalancer service multiport-test in namespace e2e-tests-mpservice-8tqc4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:900]
  Mar 14 20:39:14.811: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:903]
  Mar 14 20:39:14.844: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:39:24.881: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:39:34.879: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:39:44.885: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:39:54.887: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:40:04.881: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:40:14.878: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:158]
  Mar 14 20:40:24.886: INFO: Exposure successfully, get external ip: 20.175.135.19 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
  Mar 14 20:40:24.886: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-mpservice-8tqc4 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159]
  Mar 14 20:40:24.886: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-mpservice-8tqc4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152]
  Mar 14 20:40:24.966: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317]
  Mar 14 20:40:35.003: INFO: checking the connectivity of addr 20.175.135.19:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:124]
  Mar 14 20:40:35.003: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107]
... skipping 120 lines ...
[ReportAfterSuite] Autogenerated ReportAfterSuite for --junit-report
autogenerated by Ginkgo
[ReportAfterSuite] PASSED [0.018 seconds]
------------------------------

Summarizing 1 Failure:
  [FAIL] Service with annotation [It] should support service annotation `service.beta.kubernetes.io/azure-pip-prefix-id` [ServiceAnnotation]
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:469

Ran 47 of 63 Specs in 7938.613 seconds
FAIL! -- 46 Passed | 1 Failed | 0 Pending | 16 Skipped
--- FAIL: TestAzureTest (7938.63s)
FAIL
You're using deprecated Ginkgo functionality:
=============================================
  --ginkgo.slow-spec-threshold is deprecated --slow-spec-threshold has been deprecated and will be removed in a future version of Ginkgo.  This feature has proved to be more noisy than useful.  You can use --poll-progress-after, instead, to get more actionable feedback about potentially slow specs and understand where they might be getting stuck.

To silence deprecations that can be silenced set the following environment variable:
  ACK_GINKGO_DEPRECATIONS=2.9.1


Ginkgo ran 1 suite in 2h13m40.512546701s

Test Suite Failed
make: *** [Makefile:367: test-ccm-e2e] Error 1
NAME                              STATUS   ROLES           AGE    VERSION                           INTERNAL-IP   EXTERNAL-IP   OS-IMAGE             KERNEL-VERSION     CONTAINER-RUNTIME
capz-12tq54-control-plane-jr5qp   Ready    control-plane   138m   v1.24.12-rc.0.26+5c76b515b703c0   10.0.0.4      <none>        Ubuntu 18.04.6 LTS   5.4.0-1104-azure   containerd://1.6.18
capz-12tq54-md-0-4bpzq            Ready    <none>          135m   v1.24.12-rc.0.26+5c76b515b703c0   10.1.0.4      <none>        Ubuntu 18.04.6 LTS   5.4.0-1104-azure   containerd://1.6.18
capz-12tq54-md-0-dmpfp            Ready    <none>          134m   v1.24.12-rc.0.26+5c76b515b703c0   10.1.0.5      <none>        Ubuntu 18.04.6 LTS   5.4.0-1104-azure   containerd://1.6.18
NAMESPACE          NAME                                                      READY   STATUS    RESTARTS   AGE    IP                NODE                              NOMINATED NODE   READINESS GATES
calico-apiserver   calico-apiserver-ff87468d9-fx6k7                          1/1     Running   0          136m   192.168.158.134   capz-12tq54-control-plane-jr5qp   <none>           <none>
... skipping 95 lines ...
  Mar 14 20:46:15.679: INFO: Describing Pod kube-system/kube-scheduler-capz-12tq54-control-plane-jr5qp
  Mar 14 20:46:15.679: INFO: Creating log watcher for controller kube-system/kube-scheduler-capz-12tq54-control-plane-jr5qp, container kube-scheduler
  Mar 14 20:46:16.081: INFO: Fetching kube-system pod logs took 8.755783901s
  Mar 14 20:46:16.081: INFO: Dumping workload cluster default/capz-12tq54 Azure activity log
  Mar 14 20:46:16.081: INFO: Creating log watcher for controller kube-system/metrics-server-7d674f87b8-fpf9v, container metrics-server
  Mar 14 20:46:16.081: INFO: Describing Pod kube-system/metrics-server-7d674f87b8-fpf9v
  Mar 14 20:46:28.638: INFO: Got error while iterating over activity logs for resource group capz-12tq54: insights.ActivityLogsClient#listNextResults: Failure responding to next results request: StatusCode=404 -- Original Error: autorest/azure: error response cannot be parsed: {"<!DOCTYPE html PUBLIC \"-//W3C//DTD XHTML 1.0 Strict//EN\" \"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd\">\r\n<html xmlns=\"http://www.w3.org/1999/xhtml\">\r\n<head>\r\n<meta http-equiv=\"Content-Type\" content=\"text/html; charset=iso-8859-1\"/>\r\n<title>404 - File or directory not found.</title>\r\n<style type=\"text/css\">\r\n<!--\r\nbody{margin:0;font-size:.7em;font-family:Verdana, Arial, Helvetica, sans-serif;background:#EEEEEE;}\r\nfieldset{padding:0 15px 10px 15px;} \r\nh1{font-size:2.4em;margin:0;color:#FFF;}\r\nh2{font-si" '\x00' '\x00'} error: invalid character '<' looking for beginning of value
  Mar 14 20:46:28.638: INFO: Fetching activity logs took 12.557197389s
================ REDACTING LOGS ================
All sensitive variables are redacted
cluster.cluster.x-k8s.io "capz-12tq54" deleted
make: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kind-v0.17.0 delete cluster --name=capz || true
... skipping 15 lines ...