kubernetes-sigs/cloud-provider-azure PR #3266 pull-cloud-provider-azure-e2e-ccm-capz #1622493535339024384
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | lzhecheng: Support dual-stack in azure_loadbalancer_backendpool.go |
| Result | ABORTED |
| Tests | 0 failed / 0 succeeded |
| Started | |
| Elapsed | 1h4m |
| Revision | 6564bb1d4af116327b43907ddddb13a5ad6fe4cc |
| Refs |
3266 |
... skipping 139 lines ... https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded /home/prow/go/src/sigs.k8s.io/cloud-provider-azure /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure Image Tag is a88375a Error response from daemon: manifest for capzci.azurecr.io/azure-cloud-controller-manager:a88375a not found: manifest unknown: manifest tagged by "a88375a" is not found Build Linux Azure amd64 cloud controller manager make: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure' make ARCH=amd64 build-ccm-image make[1]: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure' docker buildx inspect img-builder > /dev/null 2>&1 || docker buildx create --name img-builder --use img-builder ... skipping 286 lines ... #16 sending tarball #16 sending tarball 1.1s done #16 DONE 3.8s #17 importing to docker #17 DONE 0.8s WARNING: failed to get git remote url: fatal: No remote configured to list refs from. make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure' make ARCH=amd64 push-ccm-image make[1]: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure' docker push capzci.azurecr.io/azure-cloud-controller-manager:a88375a The push refers to repository [capzci.azurecr.io/azure-cloud-controller-manager] d2ffdd5a435a: Preparing ... skipping 186 lines ... #14 sending tarball #14 sending tarball 1.2s done #14 DONE 3.8s #15 importing to docker #15 DONE 0.8s WARNING: failed to get git remote url: fatal: No remote configured to list refs from. make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure' make ARCH=amd64 push-node-image-linux-push-name make[1]: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure' docker tag capzci.azurecr.io/azure-cloud-node-manager:a88375a-linux-amd64 capzci.azurecr.io/azure-cloud-node-manager:a88375a docker push capzci.azurecr.io/azure-cloud-node-manager:a88375a The push refers to repository [capzci.azurecr.io/azure-cloud-node-manager] ... skipping 648 lines ... certificate.cert-manager.io "selfsigned-cert" deleted # Create secret for AzureClusterIdentity ./hack/create-identity-secret.sh make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' make[2]: Nothing to be done for 'kubectl'. make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Error from server (NotFound): secrets "cluster-identity-secret" not found secret/cluster-identity-secret created secret/cluster-identity-secret labeled # Create customized cloud provider configs ./hack/create-custom-cloud-provider-config.sh make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' make[2]: Nothing to be done for 'kubectl'. ... skipping 137 lines ... # Wait for the kubeconfig to become available. timeout --foreground 300 bash -c "while ! /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 get secrets | grep capz-7sjng4-kubeconfig; do sleep 1; done" capz-7sjng4-kubeconfig cluster.x-k8s.io/secret 1 0s # Get kubeconfig and store it locally. /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 get secrets capz-7sjng4-kubeconfig -o json | jq -r .data.value | base64 --decode > ./kubeconfig timeout --foreground 600 bash -c "while ! /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 --kubeconfig=./kubeconfig get nodes | grep control-plane; do sleep 1; done" error: the server doesn't have a resource type "nodes" capz-7sjng4-control-plane-s4jd7 NotReady control-plane 13s v1.27.0-alpha.1.249+cf14b50b0d2215 run "/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 --kubeconfig=./kubeconfig ..." to work with the new target cluster make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' CCM cluster CIDR: 192.168.0.0/16 Waiting for 1 control plane machine(s), 2 worker machine(s), and windows machine(s) to become Ready node/capz-7sjng4-control-plane-s4jd7 condition met ... skipping 56 lines ... Feb 6 07:36:48.752: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/standard_lb.go:70] Feb 6 07:36:48.850: INFO: 5 pods in namespace e2e-tests-service-lb-5xmbg are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] Feb 6 07:36:58.949: INFO: 0 pods in namespace e2e-tests-service-lb-5xmbg are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] Feb 6 07:36:58.950: INFO: Creating service servicelb-test in namespace e2e-tests-service-lb-5xmbg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1219] Feb 6 07:36:59.029: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-5xmbg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1223] Feb 6 07:36:59.030: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1226] Feb 6 07:36:59.092: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:37:09.166: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:37:19.160: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:37:29.165: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:37:39.166: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:37:49.167: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:37:59.158: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:38:09.164: INFO: Exposure successfully, get external ip: [20.106.71.134] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:189] Feb 6 07:38:09.164: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-5xmbg to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159] Feb 6 07:38:09.164: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-lb-5xmbg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152] Feb 6 07:38:09.300: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317] Feb 6 07:38:19.368: INFO: checking the connectivity of address 20.106.71.134 80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:133] Feb 6 07:38:19.369: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107] ... skipping 14 lines ... Feb 6 07:38:22.569: INFO: Validation succeeded for a non-VMSS cluster [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/standard_lb.go:165] Feb 6 07:38:22.636: INFO: Deleting namespace e2e-tests-service-lb-5xmbg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:135] [38;5;10m• [174.063 seconds][0m [38;5;243m------------------------------[0m [38;5;14mS[0m [38;5;243m------------------------------[0m [0mMulti-ports service [38;5;243mWhen ExternalTrafficPolicy is updated [0m[1mShould not have error occurred[0m [38;5;204m[Multi-Ports][0m [38;5;243m/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1015[0m Feb 6 07:39:38.850: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:56] Feb 6 07:39:38.850: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:64] Feb 6 07:39:38.919: INFO: Created a test namespace "e2e-tests-mpservice-2dl84" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:110] Feb 6 07:39:38.919: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:969] Feb 6 07:39:38.919: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:56] ... skipping 5 lines ... Feb 6 07:39:42.714: INFO: 5 pods in namespace e2e-tests-mpservice-2dl84 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] Feb 6 07:39:52.802: INFO: 0 pods in namespace e2e-tests-mpservice-2dl84 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] [1mSTEP:[0m Getting the service [38;5;243m@ 02/06/23 07:39:52.802[0m Feb 6 07:39:52.802: INFO: Creating service multiport-test in namespace e2e-tests-mpservice-2dl84 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1018] Feb 6 07:39:52.957: INFO: Successfully created LoadBalancer service multiport-test in namespace e2e-tests-mpservice-2dl84 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1022] Feb 6 07:39:52.957: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1025] Feb 6 07:39:53.021: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:40:03.092: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:40:13.085: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:40:23.087: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:40:33.084: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:40:43.092: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:40:53.092: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:41:03.085: INFO: Exposure successfully, get external ip: [20.106.108.79] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:189] Feb 6 07:41:03.085: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-mpservice-2dl84 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159] Feb 6 07:41:03.085: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-mpservice-2dl84 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152] Feb 6 07:41:03.221: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317] Feb 6 07:41:13.288: INFO: checking the connectivity of address 20.106.108.79 80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:133] Feb 6 07:41:13.288: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107] ... skipping 60 lines ... Feb 6 07:42:18.152: INFO: 5 pods in namespace e2e-tests-nsg-xq7qm are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] Feb 6 07:42:28.241: INFO: 0 pods in namespace e2e-tests-nsg-xq7qm are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] [1mSTEP:[0m Creating a service and expose it [38;5;243m@ 02/06/23 07:42:28.241[0m Feb 6 07:42:28.241: INFO: Creating service nsg-test in namespace e2e-tests-nsg-xq7qm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1219] Feb 6 07:42:28.332: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-xq7qm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1223] Feb 6 07:42:28.332: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1226] Feb 6 07:42:28.394: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:42:38.457: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:42:48.458: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:42:58.457: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:43:08.461: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:43:18.468: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:43:28.466: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:43:38.457: INFO: Exposure successfully, get external ip: [20.106.108.79] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:189] Feb 6 07:43:38.457: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-xq7qm to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159] Feb 6 07:43:38.457: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-nsg-xq7qm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152] Feb 6 07:43:38.594: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317] Feb 6 07:43:48.661: INFO: checking the connectivity of address 20.106.108.79 80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:133] Feb 6 07:43:48.662: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107] ... skipping 47 lines ... Feb 6 07:45:10.595: INFO: 5 pods in namespace e2e-tests-nsg-h76z8 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] Feb 6 07:45:20.683: INFO: 0 pods in namespace e2e-tests-nsg-h76z8 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] [1mSTEP:[0m Exposing two services with shared security rule [38;5;243m@ 02/06/23 07:45:20.683[0m Feb 6 07:45:20.683: INFO: Creating service nsg-test in namespace e2e-tests-nsg-h76z8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1219] Feb 6 07:45:20.773: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-h76z8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1223] Feb 6 07:45:20.773: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1226] Feb 6 07:45:20.837: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:45:30.908: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:45:40.901: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:45:50.900: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:46:00.910: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:46:10.910: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:46:20.901: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:46:30.901: INFO: Exposure successfully, get external ip: [20.106.64.128] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:189] Feb 6 07:46:30.901: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-h76z8 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159] Feb 6 07:46:30.901: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-nsg-h76z8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152] Feb 6 07:46:31.036: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317] Feb 6 07:46:41.104: INFO: checking the connectivity of address 20.106.64.128 80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:133] Feb 6 07:46:41.104: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107] ... skipping 2 lines ... Feb 6 07:46:41.890: INFO: stdout: "" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:177] Feb 6 07:46:41.890: INFO: Validation succeeded: Service addr 20.106.64.128 and port 80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:210] Feb 6 07:46:41.962: INFO: Deleting pod exec-agnhost-pod in namespace e2e-tests-nsg-h76z8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:138] Feb 6 07:46:42.024: INFO: Creating service nsg-test-share in namespace e2e-tests-nsg-h76z8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1219] Feb 6 07:46:42.111: INFO: Successfully created LoadBalancer service nsg-test-share in namespace e2e-tests-nsg-h76z8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1223] Feb 6 07:46:42.111: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1226] Feb 6 07:46:42.177: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:46:52.240: INFO: Exposure successfully, get external ip: [20.125.111.192] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:189] Feb 6 07:46:52.240: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-h76z8 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159] Feb 6 07:46:52.240: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-nsg-h76z8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152] Feb 6 07:46:52.372: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317] Feb 6 07:47:02.447: INFO: checking the connectivity of address 20.125.111.192 80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:133] Feb 6 07:47:02.447: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107] ... skipping 43 lines ... Feb 6 07:48:49.195: INFO: 5 pods in namespace e2e-tests-nsg-hbb4w are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] Feb 6 07:48:59.292: INFO: 0 pods in namespace e2e-tests-nsg-hbb4w are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] [1mSTEP:[0m Creating service and wait it to expose [38;5;243m@ 02/06/23 07:48:59.292[0m Feb 6 07:48:59.292: INFO: Creating service nsg-test in namespace e2e-tests-nsg-hbb4w [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:193] Feb 6 07:48:59.366: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-hbb4w [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:197] [1mSTEP:[0m Waiting for the service to be exposed [38;5;243m@ 02/06/23 07:48:59.366[0m Feb 6 07:48:59.428: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:49:09.492: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:49:19.492: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:49:29.500: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:49:39.501: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:49:49.501: INFO: Exposure successfully, get external ip: [20.106.64.128] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:189] [1mSTEP:[0m Validating if the corresponding IP prefix existing in nsg [38;5;243m@ 02/06/23 07:49:49.501[0m Feb 6 07:49:49.502: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:211] Feb 6 07:49:50.245: INFO: got sg list, length = 2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:236] Feb 6 07:49:50.312: INFO: Deleting namespace e2e-tests-nsg-hbb4w [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:135] [38;5;10m• [125.148 seconds][0m ... skipping 10 lines ... Feb 6 07:50:54.095: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:69] Feb 6 07:50:54.161: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:74] Feb 6 07:50:54.256: INFO: 5 pods in namespace e2e-tests-nsg-8vbcf are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] Feb 6 07:51:04.351: INFO: 0 pods in namespace e2e-tests-nsg-8vbcf are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] [1mSTEP:[0m Creating a test service with the deny rule annotation but without `service.Spec.LoadBalancerSourceRanges` [38;5;243m@ 02/06/23 07:51:04.351[0m [1mSTEP:[0m Waiting for the service to expose [38;5;243m@ 02/06/23 07:51:04.432[0m Feb 6 07:51:04.496: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:51:14.565: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:51:24.560: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:51:34.568: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:51:44.560: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:51:54.568: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:52:04.568: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:52:14.569: INFO: Exposure successfully, get external ip: [10.1.0.6] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:189] Feb 6 07:52:14.569: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-8vbcf to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159] Feb 6 07:52:14.569: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-nsg-8vbcf [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152] Feb 6 07:52:14.703: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317] Feb 6 07:52:24.775: INFO: checking the connectivity of address 10.1.0.6 80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:133] Feb 6 07:52:24.776: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107] ... skipping 11 lines ... Feb 6 07:52:26.496: INFO: Deleting service "nsg-test" in namespace "e2e-tests-nsg-8vbcf" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:47] [1mSTEP:[0m Creating a test service with the deny rule annotation and `service.Spec.LoadBalancerSourceRanges` [38;5;243m@ 02/06/23 07:53:02.691[0m Feb 6 07:53:02.691: INFO: Creating a hostNetwork Pod exec-agnhost-pod-deny-all-except-lb-range in namespace e2e-tests-nsg-8vbcf to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159] Feb 6 07:53:02.691: INFO: creating pod exec-agnhost-pod-deny-all-except-lb-range in namespace e2e-tests-nsg-8vbcf [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152] Feb 6 07:53:02.826: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317] [1mSTEP:[0m Waiting for the service to expose [38;5;243m@ 02/06/23 07:53:13.039[0m Feb 6 07:53:13.102: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:53:23.173: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:53:33.168: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:53:43.174: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:53:53.173: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:54:03.165: INFO: Exposure successfully, get external ip: [10.1.0.6] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:189] Feb 6 07:54:03.165: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:281] Feb 6 07:54:03.165: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107] Feb 6 07:54:03.165: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-nsg-8vbcf exec exec-agnhost-pod-deny-all-except-lb-range -- /bin/sh -x -c nc -vz -w 4 10.1.0.6 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:149] Feb 6 07:54:03.953: INFO: stderr: "+ nc -vz -w 4 10.1.0.6 80\nConnection to 10.1.0.6 80 port [tcp/http] succeeded!\n" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:176] Feb 6 07:54:03.953: INFO: stdout: "" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:177] ... skipping 27 lines ... Feb 6 07:55:08.796: INFO: 5 pods in namespace e2e-tests-nsg-bfdp4 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] Feb 6 07:55:18.886: INFO: 0 pods in namespace e2e-tests-nsg-bfdp4 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] [1mSTEP:[0m Creating a public IP with tags [38;5;243m@ 02/06/23 07:55:18.886[0m Feb 6 07:55:18.887: INFO: Creating public IP resource named nsg-public-IP-disable-floating-ip [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:269] Feb 6 07:55:23.405: INFO: created pip with address 20.171.50.48 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:304] [1mSTEP:[0m Creating a test load balancer service with floating IP disabled [38;5;243m@ 02/06/23 07:55:23.405[0m Feb 6 07:55:23.541: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:55:33.607: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:55:43.604: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:55:53.613: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:56:03.615: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:56:13.614: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:56:23.608: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:56:33.609: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:56:43.611: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:56:53.605: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:57:03.614: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:57:13.605: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:57:23.605: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:57:33.604: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:57:43.610: INFO: Exposure successfully, get external ip: [20.171.50.48] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:189] Feb 6 07:57:43.610: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-bfdp4 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159] Feb 6 07:57:43.610: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-nsg-bfdp4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152] Feb 6 07:57:43.750: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317] Feb 6 07:57:53.817: INFO: checking the connectivity of address 20.171.50.48 80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:133] Feb 6 07:57:53.817: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107] ... skipping 50 lines ... Feb 6 07:59:10.071: INFO: 5 pods in namespace e2e-tests-service-f44xm are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] Feb 6 07:59:20.167: INFO: 0 pods in namespace e2e-tests-service-f44xm are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:87] [1mSTEP:[0m Create a Service with managed PIP [38;5;243m@ 02/06/23 07:59:20.167[0m Feb 6 07:59:20.167: INFO: Creating service annotation-test in namespace e2e-tests-service-f44xm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1219] Feb 6 07:59:20.243: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-f44xm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1223] Feb 6 07:59:20.243: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:1226] Feb 6 07:59:20.306: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:59:30.378: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:59:40.374: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 07:59:50.378: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 08:00:00.377: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 08:00:10.369: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 08:00:20.370: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 08:00:30.377: INFO: Exposure successfully, get external ip: [20.125.78.18] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:189] Feb 6 08:00:30.377: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-f44xm to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:159] Feb 6 08:00:30.377: INFO: creating pod exec-agnhost-pod in namespace e2e-tests-service-f44xm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:152] Feb 6 08:00:30.512: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:317] Feb 6 08:00:40.587: INFO: checking the connectivity of address 20.125.78.18 80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:133] Feb 6 08:00:40.587: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:107] ... skipping 15 lines ... [1mSTEP:[0m Delete the Service [38;5;243m@ 02/06/23 08:00:52.513[0m Feb 6 08:00:52.513: INFO: Deleting service "annotation-test" in namespace "e2e-tests-service-f44xm" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:47] [1mSTEP:[0m Create a PIP [38;5;243m@ 02/06/23 08:01:52.706[0m Feb 6 08:01:52.706: INFO: Creating public IP resource named service-public-IP-94ab [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:269] Feb 6 08:01:57.058: INFO: PIP "service-public-IP-94ab" to "20.172.1.45" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:189] [1mSTEP:[0m Create a Service which will be deleted with the PIP [38;5;243m@ 02/06/23 08:01:57.058[0m Feb 6 08:01:57.198: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 08:02:07.270: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 08:02:17.261: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 08:02:27.262: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169] Feb 6 08:02:37.268: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:169]