This job view page is being replaced by Spyglass soon. Check out the new job view.
PRlzhecheng: [WIP][NOT FOR REVIEW] Improve test stability
ResultFAILURE
Tests 1 failed / 33 succeeded
Started2022-07-07 08:02
Elapsed1h14m
Revisionce32afde55b138154d4a2c4d104290ca06c0f1b1
Refs 968

Test Failures


Cloud provider Azure e2e suite Azure Credential Provider should be able to pull private images from acr without docker secrets set explicitly 17s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Cloud\sprovider\sAzure\se2e\ssuite\sAzure\sCredential\sProvider\sshould\sbe\sable\sto\spull\sprivate\simages\sfrom\sacr\swithout\sdocker\ssecrets\sset\sexplicitly$'
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/auth/cred.go:58
Unexpected error:
    <*fmt.wrapError | 0xc000958da0>: {
        msg: "docker failed to login with error: exit status 1",
        err: <*exec.ExitError | 0xc000958d80>{
            ProcessState: {
                pid: 59253,
                status: 256,
                rusage: {
                    Utime: {Sec: 0, Usec: 30237},
                    Stime: {Sec: 0, Usec: 25861},
                    Maxrss: 595516,
                    Ixrss: 0,
                    Idrss: 0,
                    Isrss: 0,
                    Minflt: 5579,
                    Majflt: 0,
                    Nswap: 0,
                    Inblock: 0,
                    Oublock: 0,
                    Msgsnd: 0,
                    Msgrcv: 0,
                    Nsignals: 0,
                    Nvcsw: 221,
                    Nivcsw: 5,
                },
            },
            Stderr: nil,
        },
    }
    docker failed to login with error: exit status 1
occurred
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/auth/cred.go:70
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Show 33 Passed Tests

Show 23 Skipped Tests

Error lines from build-log.txt

... skipping 181 lines ...
https://docs.docker.com/engine/reference/commandline/login/#credentials-store

Login Succeeded
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure
/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure
Image Tag is 373316f
Error response from daemon: manifest for capzci.azurecr.io/azure-cloud-controller-manager:373316f not found: manifest unknown: manifest tagged by "373316f" is not found
Build Linux Azure amd64 cloud controller manager
make: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure'
make ARCH=amd64 build-ccm-image
make[1]: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure'
docker buildx inspect img-builder > /dev/null 2>&1 || docker buildx create --name img-builder --use
img-builder
... skipping 1077 lines ...
certificate.cert-manager.io "selfsigned-cert" deleted
# Create secret for AzureClusterIdentity
./hack/create-identity-secret.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
Error from server (NotFound): secrets "cluster-identity-secret" not found
secret/cluster-identity-secret created
secret/cluster-identity-secret labeled
# Create customized cloud provider configs
./hack/create-custom-cloud-provider-config.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
... skipping 224 lines ...
Jul  7 08:22:41.641: INFO: 5 pods in namespace e2e-tests-service-7r2jh are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:22:51.789: INFO: 0 pods in namespace e2e-tests-service-7r2jh are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Create service
Jul  7 08:22:51.789: INFO: Creating service annotation-test in namespace e2e-tests-service-7r2jh [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:906]
Jul  7 08:22:51.914: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-7r2jh [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:910]
Jul  7 08:22:51.914: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:913]
Jul  7 08:22:52.018: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:23:02.126: INFO: Exposure successfully, get external ip: 20.223.92.150 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:23:02.126: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-7r2jh to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:23:02.345: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:23:12.463: INFO: checking the connectivity of addr 20.223.92.150:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:23:12.463: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:23:12.463: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-7r2jh exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.223.92.150 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
Jul  7 08:23:13.822: INFO: stderr: "+ nc -vz -w 4 20.223.92.150 80\nConnection to 20.223.92.150 80 port [tcp/http] succeeded!\n" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:165]
Jul  7 08:23:13.822: INFO: stdout: "" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:166]
Jul  7 08:23:13.822: INFO: Validation succeeded: Service addr 20.223.92.150:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:198]
Jul  7 08:23:13.946: INFO: Deleting pod exec-agnhost-pod in namespace e2e-tests-service-7r2jh [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:118]
STEP: Validating External domain name
Jul  7 08:23:14.052: INFO: Get domain name: annotation-test92b83191-5f7a-42d8-a00f-d0eb147511b3.northeurope.cloudapp.azure.com [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:74]
Jul  7 08:23:44.070: INFO: Received the following error when validating http://annotation-test92b83191-5f7a-42d8-a00f-d0eb147511b3.northeurope.cloudapp.azure.com:80: Get "http://annotation-test92b83191-5f7a-42d8-a00f-d0eb147511b3.northeurope.cloudapp.azure.com:80": dial tcp 20.223.92.150:80: i/o timeout [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:168]
Jul  7 08:23:44.070: INFO: Retrying in 20 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:170]
Jul  7 08:24:04.345: INFO: cleaning up test service annotation-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:143]
Jul  7 08:24:04.345: INFO: Deleting service annotation-test in namespace e2e-tests-service-7r2jh [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:47]
Jul  7 08:24:31.044: INFO: Deleting namespace e2e-tests-service-7r2jh [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:134]

• [SLOW TEST:116.222 seconds]
... skipping 15 lines ...
Jul  7 08:24:37.721: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:97]
Jul  7 08:24:37.875: INFO: 5 pods in namespace e2e-tests-service-tl895 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:24:48.022: INFO: 0 pods in namespace e2e-tests-service-tl895 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:24:48.022: INFO: Creating service annotation-test in namespace e2e-tests-service-tl895 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:906]
Jul  7 08:24:48.164: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-tl895 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:910]
Jul  7 08:24:48.164: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:913]
Jul  7 08:24:48.274: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:24:58.381: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:24:58.381: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-tl895 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:24:58.593: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:25:08.702: INFO: checking the connectivity of addr 10.1.0.6:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:25:08.702: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:25:08.702: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-tl895 exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  10.1.0.6 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 28 lines ...
Jul  7 08:25:39.804: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:37]
STEP: Test subnet doesn't exist. Creating a new one...
Jul  7 08:25:42.754: INFO: creating a new subnet a--------------------------------------------------z, 10.2.0.0/24 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:74]
Jul  7 08:25:43.425: INFO: Creating service annotation-test in namespace e2e-tests-service-6947g [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:906]
Jul  7 08:25:43.548: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-6947g [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:910]
Jul  7 08:25:43.548: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:913]
Jul  7 08:25:43.654: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:25:53.759: INFO: Exposure successfully, get external ip: 10.2.0.4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:25:53.759: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-6947g to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:25:53.986: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:26:04.096: INFO: checking the connectivity of addr 10.2.0.4:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:26:04.096: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:26:04.096: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-6947g exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  10.2.0.4 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 28 lines ...
Jul  7 08:26:37.934: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:97]
Jul  7 08:26:38.081: INFO: 5 pods in namespace e2e-tests-service-8kdmf are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:26:48.223: INFO: 0 pods in namespace e2e-tests-service-8kdmf are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:26:48.223: INFO: Creating service annotation-test in namespace e2e-tests-service-8kdmf [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:906]
Jul  7 08:26:48.339: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-8kdmf [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:910]
Jul  7 08:26:48.339: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:913]
Jul  7 08:26:48.443: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:26:58.554: INFO: Exposure successfully, get external ip: 20.191.49.179 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:26:58.554: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-8kdmf to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:26:58.771: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:27:08.890: INFO: checking the connectivity of addr 20.191.49.179:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:27:08.891: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:27:08.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-8kdmf exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.191.49.179 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 32 lines ...
STEP: resource group e2e-4389 created
STEP: creating test PIP in the test resource group
Jul  7 08:28:01.120: INFO: Creating public IP resource named testPIP-6f25 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:191]
STEP: Creating service annotation-test in namespace e2e-tests-service-crchr
Jul  7 08:28:05.606: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-crchr [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:305]
STEP: Waiting service to expose...
Jul  7 08:28:05.710: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:28:15.818: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:28:25.820: INFO: Exposure successfully, get external ip: 23.102.53.168 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:28:25.821: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-crchr to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:28:26.037: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:28:36.154: INFO: checking the connectivity of addr 23.102.53.168:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:28:36.154: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:28:36.154: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-crchr exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  23.102.53.168 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 34 lines ...
Jul  7 08:30:10.696: INFO: 5 pods in namespace e2e-tests-service-672gn are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:30:20.836: INFO: 0 pods in namespace e2e-tests-service-672gn are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Exposing two services with shared security rule
Jul  7 08:30:20.836: INFO: Creating service annotation-test in namespace e2e-tests-service-672gn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:906]
Jul  7 08:30:20.958: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-672gn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:910]
Jul  7 08:30:20.958: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:913]
Jul  7 08:30:21.061: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:30:31.174: INFO: Exposure successfully, get external ip: 20.54.37.140 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:30:31.174: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-672gn to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:30:31.389: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:30:41.499: INFO: checking the connectivity of addr 20.54.37.140:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:30:41.499: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:30:41.499: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-672gn exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.54.37.140 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
Jul  7 08:30:42.715: INFO: stderr: "+ nc -vz -w 4 20.54.37.140 80\nConnection to 20.54.37.140 80 port [tcp/http] succeeded!\n" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:165]
Jul  7 08:30:42.715: INFO: stdout: "" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:166]
Jul  7 08:30:42.715: INFO: Validation succeeded: Service addr 20.54.37.140:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:198]
Jul  7 08:30:42.833: INFO: Deleting pod exec-agnhost-pod in namespace e2e-tests-service-672gn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:118]
Jul  7 08:30:42.936: INFO: Creating service annotation-test-share in namespace e2e-tests-service-672gn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:906]
Jul  7 08:30:43.097: INFO: Successfully created LoadBalancer service annotation-test-share in namespace e2e-tests-service-672gn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:910]
Jul  7 08:30:43.097: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:913]
Jul  7 08:30:43.214: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:30:53.326: INFO: Exposure successfully, get external ip: 20.191.54.220 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:30:53.326: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-672gn to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:30:53.547: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:31:03.665: INFO: checking the connectivity of addr 20.191.54.220:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:31:03.665: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:31:03.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-672gn exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.191.54.220 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 31 lines ...
Jul  7 08:31:57.546: INFO: Creating deployment annotation-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:92]
Jul  7 08:31:57.651: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:97]
Jul  7 08:31:57.807: INFO: 5 pods in namespace e2e-tests-service-ncnbx are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:32:07.948: INFO: 0 pods in namespace e2e-tests-service-ncnbx are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Creating a service with custom tags
STEP: Waiting service to expose...
Jul  7 08:32:08.224: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:32:18.336: INFO: Exposure successfully, get external ip: 20.54.35.106 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:32:18.336: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-ncnbx to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:32:18.647: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:32:28.755: INFO: checking the connectivity of addr 20.54.35.106:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:32:28.755: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:32:28.755: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-ncnbx exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.54.35.106 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 32 lines ...
Jul  7 08:33:15.973: INFO: 0 pods in namespace e2e-tests-service-b5rtz are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Creating two test pips
Jul  7 08:33:15.973: INFO: Creating public IP resource named pip1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:191]
Jul  7 08:33:19.154: INFO: Creating public IP resource named pip2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:191]
STEP: Creating a service referring to the first pip
STEP: Waiting for the service to expose
Jul  7 08:33:22.456: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:33:32.560: INFO: Exposure successfully, get external ip: 137.135.250.170 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:33:32.560: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-b5rtz to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:33:32.773: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:33:42.881: INFO: checking the connectivity of addr 137.135.250.170:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:33:42.881: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:33:42.881: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-b5rtz exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  137.135.250.170 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 43 lines ...
Jul  7 08:34:29.640: INFO: 0 pods in namespace e2e-tests-service-s4n42 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Creating two test PIPPrefix
Jul  7 08:34:29.640: INFO: Creating PublicIPPrefix named prefix1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:216]
Jul  7 08:34:32.722: INFO: Creating PublicIPPrefix named prefix2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:216]
STEP: Creating a service referring to the prefix
STEP: Waiting for the service to expose
Jul  7 08:34:35.774: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:34:45.881: INFO: Exposure successfully, get external ip: 52.169.202.176 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:34:45.881: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-s4n42 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:34:46.097: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:34:56.206: INFO: checking the connectivity of addr 52.169.202.176:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:34:56.206: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:34:56.207: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-s4n42 exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  52.169.202.176 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 44 lines ...
Jul  7 08:36:06.914: INFO: 5 pods in namespace e2e-tests-service-z59n8 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:36:17.061: INFO: 0 pods in namespace e2e-tests-service-z59n8 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Creating a service with health probe annotations
Jul  7 08:36:17.061: INFO: Creating service annotation-test in namespace e2e-tests-service-z59n8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:906]
Jul  7 08:36:17.263: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-z59n8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:910]
Jul  7 08:36:17.263: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:913]
Jul  7 08:36:17.370: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:36:27.481: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:36:37.474: INFO: Exposure successfully, get external ip: 20.54.38.102 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:36:37.474: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-z59n8 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:36:37.698: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:36:47.815: INFO: checking the connectivity of addr 20.54.38.102:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:36:47.815: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:36:47.815: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-z59n8 exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.54.38.102 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 33 lines ...
Jul  7 08:37:14.997: INFO: 5 pods in namespace e2e-tests-service-kpg55 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:37:25.138: INFO: 0 pods in namespace e2e-tests-service-kpg55 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Creating a service with health probe annotations
Jul  7 08:37:25.139: INFO: Creating service annotation-test in namespace e2e-tests-service-kpg55 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:906]
Jul  7 08:37:25.274: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-kpg55 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:910]
Jul  7 08:37:25.274: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:913]
Jul  7 08:37:25.395: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:37:35.505: INFO: Exposure successfully, get external ip: 20.54.38.127 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:37:35.505: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-kpg55 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:37:35.719: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:37:45.828: INFO: checking the connectivity of addr 20.54.38.127:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:37:45.828: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:37:45.828: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-kpg55 exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.54.38.127 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 96 lines ...
Jul  7 08:38:38.125: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/standard_lb.go:70]
Jul  7 08:38:38.270: INFO: 5 pods in namespace e2e-tests-service-lb-2bdgq are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:38:48.408: INFO: 0 pods in namespace e2e-tests-service-lb-2bdgq are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:38:48.409: INFO: Creating service servicelb-test in namespace e2e-tests-service-lb-2bdgq [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:906]
Jul  7 08:38:48.524: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-2bdgq [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:910]
Jul  7 08:38:48.524: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:913]
Jul  7 08:38:48.628: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:38:58.737: INFO: Exposure successfully, get external ip: 20.54.35.106 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:38:58.737: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-2bdgq to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:38:58.956: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:39:09.067: INFO: checking the connectivity of addr 20.54.35.106:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:39:09.067: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:39:09.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-lb-2bdgq exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.54.35.106 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 128 lines ...
Lifecycle of VMSS
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/node/vmss.go:31
  should add node object when VMSS instance allocated
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/node/vmss.go:102
------------------------------
Multi-ports service When ExternalTrafficPolicy is updated 
  Should not have error occurred
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:755
Jul  7 08:47:07.853: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jul  7 08:47:07.853: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 08:47:07.961: INFO: Created a test namespace "e2e-tests-mpservice-wqhgf" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:109]
Jul  7 08:47:07.961: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:709]
Jul  7 08:47:07.961: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
... skipping 3 lines ...
Jul  7 08:47:08.380: INFO: 5 pods in namespace e2e-tests-mpservice-wqhgf are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 08:47:18.522: INFO: 0 pods in namespace e2e-tests-mpservice-wqhgf are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Getting the service
Jul  7 08:47:18.522: INFO: Creating service multiport-test in namespace e2e-tests-mpservice-wqhgf [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:758]
Jul  7 08:47:18.657: INFO: Successfully created LoadBalancer service multiport-test in namespace e2e-tests-mpservice-wqhgf [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:762]
Jul  7 08:47:18.657: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:765]
Jul  7 08:47:18.760: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:47:28.871: INFO: Exposure successfully, get external ip: 40.127.234.179 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:47:28.871: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-mpservice-wqhgf to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:47:29.086: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:47:39.203: INFO: checking the connectivity of addr 40.127.234.179:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:47:39.203: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:47:39.203: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-mpservice-wqhgf exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  40.127.234.179 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 39 lines ...

• [SLOW TEST:66.005 seconds]
Multi-ports service
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:674
  When ExternalTrafficPolicy is updated
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:754
    Should not have error occurred
    /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:755
------------------------------
[[Multi-Nodepool]][VMSS] 
  should support service annotation `service.beta.kubernetes.io/azure-load-balancer-mode`
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:637
Jul  7 08:48:13.858: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
... skipping 26 lines ...
Jul  7 08:48:20.912: INFO: Created a test namespace "e2e-tests-service-lb-tcdkv" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:109]
Jul  7 08:48:20.912: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jul  7 08:48:20.912: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 08:48:21.056: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
Jul  7 08:48:21.169: INFO: Updating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:107]
STEP: creating a mixed protocol service
Jul  7 08:48:21.599: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:48:31.701: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:48:41.702: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:48:51.705: INFO: Exposure successfully, get external ip: 40.127.233.43 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:48:51.705: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-tcdkv to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:48:52.050: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:49:02.166: INFO: checking the connectivity of addr 40.127.233.43:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:49:02.166: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:49:02.166: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-lb-tcdkv exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  40.127.233.43 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 32 lines ...
Jul  7 08:49:38.369: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 08:49:38.512: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
STEP: creating a public IP with tags
Jul  7 08:49:38.617: INFO: Creating public IP resource named service-lb-public-IPedcd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:191]
Jul  7 08:49:42.247: INFO: created pip with address 20.223.209.31 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:166]
STEP: creating a service referencing the public IP
Jul  7 08:49:42.486: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:49:52.597: INFO: Exposure successfully, get external ip: 20.223.209.31 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:49:52.597: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-7mkd9 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:49:52.809: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:50:02.926: INFO: checking the connectivity of addr 20.223.209.31:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:50:02.926: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:50:02.926: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-lb-7mkd9 exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.223.209.31 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 25 lines ...
Jul  7 08:50:16.429: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 08:50:16.572: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
Jul  7 08:50:16.840: INFO: Successfully created LoadBalancer service service-lb-test in namespace e2e-tests-service-lb-4kg8j [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:200]
Jul  7 08:50:16.840: INFO: Creating public IP resource named service-lb-public-none-IPfb62 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:191]
Jul  7 08:50:19.542: INFO: PIP to 20.223.157.102 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:205]
STEP: Waiting for exposure of the original service without assigned lb IP
Jul  7 08:50:19.649: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:50:29.761: INFO: Exposure successfully, get external ip: 40.127.234.216 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:50:29.761: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-4kg8j to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:50:30.071: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:50:40.179: INFO: checking the connectivity of addr 40.127.234.216:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:50:40.179: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:50:40.179: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-lb-4kg8j exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  40.127.234.216 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 35 lines ...
Jul  7 08:51:27.426: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jul  7 08:51:27.427: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 08:51:27.570: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
Jul  7 08:51:27.675: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:37]
Jul  7 08:51:30.641: INFO: Successfully created LoadBalancer service service-lb-test in namespace e2e-tests-service-lb-nk9t8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:243]
STEP: Waiting for exposure of internal service with specific IP "10.1.0.5"
Jul  7 08:51:30.747: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:51:40.859: INFO: Exposure successfully, get external ip: 10.1.0.5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:51:40.859: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-nk9t8 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:51:41.073: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:51:51.181: INFO: checking the connectivity of addr 10.1.0.5:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:51:51.181: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:51:51.182: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-lb-nk9t8 exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  10.1.0.5 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 73 lines ...
Jul  7 08:52:47.204: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jul  7 08:52:47.204: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 08:52:47.345: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
Jul  7 08:52:47.637: INFO: Successfully created LoadBalancer service service-lb-test in namespace e2e-tests-service-lb-gb4xw [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:284]
Jul  7 08:52:47.637: INFO: Creating public IP resource named service-lb-internal-none-public-IPf27c [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:191]
STEP: Waiting for exposure of the original service without assigned lb private IP
Jul  7 08:52:51.103: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:53:01.207: INFO: Exposure successfully, get external ip: 10.1.0.5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:53:01.207: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-gb4xw to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:53:01.422: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:53:11.529: INFO: checking the connectivity of addr 10.1.0.5:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:53:11.529: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:53:11.529: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-lb-gb4xw exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  10.1.0.5 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 75 lines ...
Jul  7 08:54:07.228: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jul  7 08:54:07.228: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 08:54:07.366: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
STEP: Creating an internal Service
Jul  7 08:54:07.653: INFO: Successfully created LoadBalancer service service-lb-test in namespace e2e-tests-service-lb-hhgvn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:336]
STEP: Waiting for exposure of the internal Service
Jul  7 08:54:07.757: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:54:17.865: INFO: Exposure successfully, get external ip: 10.1.0.5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:54:17.865: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-hhgvn to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:54:18.177: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:54:28.292: INFO: checking the connectivity of addr 10.1.0.5:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:54:28.292: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:54:28.292: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-lb-hhgvn exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  10.1.0.5 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 73 lines ...
Jul  7 08:55:44.983: INFO: Created a test namespace "e2e-tests-service-lb-szth7" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:109]
Jul  7 08:55:44.983: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jul  7 08:55:44.983: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 08:55:45.122: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
Jul  7 08:55:45.510: INFO: Successfully created LoadBalancer service service-lb-test in namespace e2e-tests-service-lb-szth7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:388]
STEP: Waiting for exposure of a public Service
Jul  7 08:55:45.616: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:55:55.720: INFO: Exposure successfully, get external ip: 40.127.236.188 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:55:55.720: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-szth7 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:55:56.029: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:56:06.145: INFO: checking the connectivity of addr 40.127.236.188:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:56:06.145: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:56:06.145: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-lb-szth7 exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  40.127.236.188 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 74 lines ...
Jul  7 08:57:11.561: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jul  7 08:57:11.561: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 08:57:11.700: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
Jul  7 08:57:11.804: INFO: Creating public IP resource named service-lb-public-remain35f1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:191]
Jul  7 08:57:17.093: INFO: Successfully created LoadBalancer service service-lb-test in namespace e2e-tests-service-lb-s494n [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:425]
STEP: Waiting for exposure of the original service with assigned lb private IP
Jul  7 08:57:17.197: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 08:57:27.302: INFO: Exposure successfully, get external ip: 20.223.215.246 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 08:57:27.302: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-s494n to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 08:57:27.518: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 08:57:37.627: INFO: checking the connectivity of addr 20.223.215.246:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 08:57:37.627: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 08:57:37.627: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-lb-s494n exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.223.215.246 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 57 lines ...
Jul  7 09:02:53.341: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 09:02:53.480: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
Jul  7 09:02:53.593: INFO: Creating public IP resource named service-lb-public-remain-d458 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:191]
Jul  7 09:03:01.946: INFO: Creating Service "service-lb-test-0" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:504]
Jul  7 09:03:02.078: INFO: Creating deployment "deployment-lb-test-1" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:490]
Jul  7 09:03:02.186: INFO: Creating Service "service-lb-test-1" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:504]
Jul  7 09:03:02.489: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 09:03:12.601: INFO: Exposure successfully, get external ip: 20.223.158.240 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:03:12.601: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-9f5ml to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 09:03:12.907: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 09:03:23.021: INFO: checking the connectivity of addr 20.223.158.240:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 09:03:23.021: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 09:03:23.021: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-lb-9f5ml exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.223.158.240 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 30 lines ...
Jul  7 09:03:58.576: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jul  7 09:03:58.576: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 09:03:58.682: INFO: Created a test namespace "e2e-tests-service-lb-mtwtn" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:109]
Jul  7 09:03:58.682: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jul  7 09:03:58.682: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 09:03:58.820: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
Jul  7 09:03:59.217: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 09:04:09.323: INFO: Exposure successfully, get external ip: 40.127.237.236 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:04:09.323: INFO: Creating deployment deployment-lb-test-1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:538]
Jul  7 09:04:09.764: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 09:04:19.877: INFO: Exposure successfully, get external ip: 40.127.237.236 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:04:19.979: INFO: Exposure successfully, get external ip: 40.127.237.236 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:04:19.979: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-mtwtn to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 09:04:20.193: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 09:04:30.307: INFO: checking the connectivity of addr 40.127.237.236:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 09:04:30.307: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
... skipping 43 lines ...
Jul  7 09:05:27.059: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jul  7 09:05:27.059: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 09:05:27.172: INFO: Created a test namespace "e2e-tests-service-lb-srrpc" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:109]
Jul  7 09:05:27.172: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jul  7 09:05:27.172: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 09:05:27.311: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
Jul  7 09:05:27.715: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 09:05:37.826: INFO: Exposure successfully, get external ip: 10.1.0.5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:05:37.827: INFO: Creating deployment deployment-lb-test-1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:625]
Jul  7 09:05:38.251: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 09:05:48.354: INFO: Exposure successfully, get external ip: 10.1.0.5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:05:48.457: INFO: Exposure successfully, get external ip: 10.1.0.5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:05:48.457: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-srrpc to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 09:05:48.671: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 09:05:58.787: INFO: checking the connectivity of addr 10.1.0.5:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 09:05:58.787: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
... skipping 56 lines ...
Jul  7 09:06:52.215: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jul  7 09:06:52.357: INFO: Creating deployment deployment-lb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:88]
STEP: creating a public IP with tags
Jul  7 09:06:52.462: INFO: Creating public IP resource named service-lb-public-IP17e4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:191]
Jul  7 09:06:58.204: INFO: created pip with address 40.127.202.198 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:714]
STEP: creating a service referencing the public IP
Jul  7 09:06:58.427: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 09:07:08.536: INFO: Exposure successfully, get external ip: 40.127.202.198 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:07:08.536: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-service-lb-g9knx to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 09:07:08.749: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 09:07:18.866: INFO: checking the connectivity of addr 40.127.202.198:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 09:07:18.866: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 09:07:18.866: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-service-lb-g9knx exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  40.127.202.198 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 37 lines ...
• Failure [17.207 seconds]
Azure Credential Provider
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/auth/cred.go:32
  should be able to pull private images from acr without docker secrets set explicitly [It]
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/auth/cred.go:58

  Unexpected error:
      <*fmt.wrapError | 0xc000958da0>: {
          msg: "docker failed to login with error: exit status 1",
          err: <*exec.ExitError | 0xc000958d80>{
              ProcessState: {
                  pid: 59253,
                  status: 256,
                  rusage: {
                      Utime: {Sec: 0, Usec: 30237},
... skipping 14 lines ...
                      Nivcsw: 5,
                  },
              },
              Stderr: nil,
          },
      }
      docker failed to login with error: exit status 1
  occurred

  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/auth/cred.go:70
------------------------------
Network security group 
  should add the rule when expose a service
... skipping 8 lines ...
Jul  7 09:07:52.086: INFO: 5 pods in namespace e2e-tests-nsg-5wv79 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 09:08:02.226: INFO: 0 pods in namespace e2e-tests-nsg-5wv79 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Creating a service and expose it
Jul  7 09:08:02.226: INFO: Creating service nsg-test in namespace e2e-tests-nsg-5wv79 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:906]
Jul  7 09:08:02.357: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-5wv79 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:910]
Jul  7 09:08:02.357: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:913]
Jul  7 09:08:02.465: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 09:08:12.577: INFO: Exposure successfully, get external ip: 20.67.180.218 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:08:12.578: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-5wv79 to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 09:08:12.800: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 09:08:22.907: INFO: checking the connectivity of addr 20.67.180.218:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 09:08:22.907: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 09:08:22.908: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-nsg-5wv79 exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  20.67.180.218 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 41 lines ...
Jul  7 09:09:05.604: INFO: 5 pods in namespace e2e-tests-nsg-h92jm are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 09:09:15.742: INFO: 0 pods in namespace e2e-tests-nsg-h92jm are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Creating service and wait it to expose
Jul  7 09:09:15.742: INFO: Creating service nsg-test in namespace e2e-tests-nsg-h92jm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:150]
Jul  7 09:09:15.862: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-h92jm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:154]
STEP: Waiting for the service to be exposed
Jul  7 09:09:15.965: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 09:09:26.072: INFO: Exposure successfully, get external ip: 20.67.180.7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
STEP: Validating if the corresponding IP prefix existing in nsg
Jul  7 09:09:26.072: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:140]
Jul  7 09:09:26.335: INFO: got sg list, length = 2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:162]
Jul  7 09:09:26.441: INFO: Deleting namespace e2e-tests-nsg-h92jm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:134]

... skipping 14 lines ...
Jul  7 09:09:55.063: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:69]
Jul  7 09:09:55.168: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:74]
Jul  7 09:09:55.328: INFO: 5 pods in namespace e2e-tests-nsg-8llsk are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 09:10:05.465: INFO: 0 pods in namespace e2e-tests-nsg-8llsk are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Creating a test service with the deny rule annotation but without `service.Spec.LoadBalancerSourceRanges`
STEP: Waiting for the service to expose
Jul  7 09:10:05.687: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 09:10:15.798: INFO: Exposure successfully, get external ip: 10.1.0.5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:10:15.798: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-8llsk to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 09:10:16.011: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 09:10:26.118: INFO: checking the connectivity of addr 10.1.0.5:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 09:10:26.118: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 09:10:26.118: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-nsg-8llsk exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  10.1.0.5 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 9 lines ...
STEP: Deleting the service
Jul  7 09:10:27.809: INFO: Deleting service nsg-test in namespace e2e-tests-nsg-8llsk [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:47]
STEP: Creating a test service with the deny rule annotation and `service.Spec.LoadBalancerSourceRanges`
Jul  7 09:10:40.128: INFO: Creating a hostNetwork Pod exec-agnhost-pod-deny-all-except-lb-range in namespace e2e-tests-nsg-8llsk to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 09:10:40.342: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
STEP: Waiting for the service to expose
Jul  7 09:10:50.800: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 09:11:00.910: INFO: Exposure successfully, get external ip: 10.1.0.5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:11:00.910: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-8llsk to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 09:11:01.121: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 09:11:11.236: INFO: checking the connectivity of addr 10.1.0.5:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 09:11:11.236: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 09:11:11.236: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-nsg-8llsk exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  10.1.0.5 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 34 lines ...
Jul  7 09:11:41.993: INFO: 5 pods in namespace e2e-tests-nsg-h8qpt are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
Jul  7 09:11:52.125: INFO: 0 pods in namespace e2e-tests-nsg-h8qpt are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:84]
STEP: Creating a public IP with tags
Jul  7 09:11:52.125: INFO: Creating public IP resource named nsg-public-IP-disable-floating-ip [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:191]
Jul  7 09:11:54.351: INFO: created pip with address 13.94.124.115 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:248]
STEP: Creating a test load balancer service with floating IP disabled
Jul  7 09:11:54.574: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:162]
Jul  7 09:12:04.682: INFO: Exposure successfully, get external ip: 13.94.124.115 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:177]
Jul  7 09:12:04.682: INFO: Creating a hostNetwork Pod exec-agnhost-pod in namespace e2e-tests-nsg-h8qpt to exec [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:142]
Jul  7 09:12:04.893: INFO: waiting for the pod status to be Running, current status: Pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:258]
Jul  7 09:12:15.001: INFO: checking the connectivity of addr 13.94.124.115:80 with protocol TCP [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:128]
Jul  7 09:12:15.001: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:100]
Jul  7 09:12:15.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig --namespace=e2e-tests-nsg-h8qpt exec exec-agnhost-pod -- /bin/sh -x -c nc -vz -w 4  13.94.124.115 80' [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/kubectl.go:140]
... skipping 18 lines ...
SSSSSSS
JUnit report was created: /logs/artifacts/junit_01.xml


Summarizing 1 Failure:

[Fail] Azure Credential Provider [It] should be able to pull private images from acr without docker secrets set explicitly 
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/auth/cred.go:70

Ran 34 of 57 Specs in 3002.325 seconds
FAIL! -- 33 Passed | 1 Failed | 0 Pending | 23 Skipped

You're using deprecated Ginkgo functionality:
=============================================
Ginkgo 2.0 is under active development and will introduce several new features, improvements, and a small handful of breaking changes.
A release candidate for 2.0 is now available and 2.0 should GA in Fall 2021.  Please give the RC a try and send us feedback!
  - To learn more, view the migration guide at https://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md
... skipping 5 lines ...
  If this change will be impactful to you please leave a comment on https://github.com/onsi/ginkgo/issues/711
  Learn more at: https://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md#removed-custom-reporters

To silence deprecations that can be silenced set the following environment variable:
  ACK_GINKGO_DEPRECATIONS=1.16.5

--- FAIL: TestAzureTest (3002.34s)
FAIL
FAIL	sigs.k8s.io/cloud-provider-azure/tests/e2e	3002.388s
FAIL
make: *** [Makefile:367: test-ccm-e2e] Error 1
NAME                              STATUS   ROLES           AGE   VERSION                              INTERNAL-IP   EXTERNAL-IP   OS-IMAGE             KERNEL-VERSION     CONTAINER-RUNTIME
capz-5urn69-control-plane-z555s   Ready    control-plane   53m   v1.25.0-alpha.2.109+2a017f94bcf8d0   10.0.0.4      <none>        Ubuntu 18.04.6 LTS   5.4.0-1085-azure   containerd://1.6.2
capz-5urn69-mp-0000002            Ready    <none>          30m   v1.25.0-alpha.2.109+2a017f94bcf8d0   10.1.0.6      <none>        Ubuntu 18.04.6 LTS   5.4.0-1085-azure   containerd://1.6.2
capz-5urn69-mp-0000003            Ready    <none>          27m   v1.25.0-alpha.2.109+2a017f94bcf8d0   10.1.0.4      <none>        Ubuntu 18.04.6 LTS   5.4.0-1085-azure   containerd://1.6.2
NAMESPACE     NAME                                                      READY   STATUS    RESTARTS   AGE   IP                NODE                              NOMINATED NODE   READINESS GATES
kube-system   calico-kube-controllers-57cb778775-2kz5m                  1/1     Running   0          53m   192.168.162.194   capz-5urn69-control-plane-z555s   <none>           <none>
... skipping 55 lines ...
STEP: Collecting events for Pod kube-system/kube-proxy-t4hgf
STEP: Creating log watcher for controller kube-system/coredns-6bd5b8bf54-gkvhc, container coredns
STEP: Creating log watcher for controller kube-system/calico-node-q94k9, container calico-node
STEP: Collecting events for Pod kube-system/coredns-6bd5b8bf54-gkvhc
STEP: Creating log watcher for controller kube-system/coredns-6bd5b8bf54-pdrbn, container coredns
STEP: Collecting events for Pod kube-system/kube-scheduler-capz-5urn69-control-plane-z555s
STEP: failed to find events of Pod "kube-scheduler-capz-5urn69-control-plane-z555s"
STEP: Creating log watcher for controller kube-system/kube-scheduler-capz-5urn69-control-plane-z555s, container kube-scheduler
STEP: Creating log watcher for controller kube-system/kube-proxy-cczd9, container kube-proxy
STEP: Collecting events for Pod kube-system/coredns-6bd5b8bf54-pdrbn
STEP: Creating log watcher for controller kube-system/etcd-capz-5urn69-control-plane-z555s, container etcd
STEP: Creating log watcher for controller kube-system/metrics-server-74557696d7-zs4nc, container metrics-server
STEP: Collecting events for Pod kube-system/kube-controller-manager-capz-5urn69-control-plane-z555s
STEP: Creating log watcher for controller kube-system/calico-node-5r8b6, container calico-node
STEP: Creating log watcher for controller kube-system/kube-apiserver-capz-5urn69-control-plane-z555s, container kube-apiserver
STEP: Collecting events for Pod kube-system/kube-apiserver-capz-5urn69-control-plane-z555s
STEP: Collecting events for Pod kube-system/kube-proxy-cczd9
STEP: Creating log watcher for controller kube-system/kube-proxy-qbq68, container kube-proxy
STEP: Collecting events for Pod kube-system/etcd-capz-5urn69-control-plane-z555s
STEP: Collecting events for Pod kube-system/calico-kube-controllers-57cb778775-2kz5m
STEP: Got error while iterating over activity logs for resource group capz-5urn69: insights.ActivityLogsClient#listNextResults: Failure responding to next results request: StatusCode=404 -- Original Error: autorest/azure: error response cannot be parsed: {"<!DOCTYPE html PUBLIC \"-//W3C//DTD XHTML 1.0 Strict//EN\" \"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd\">\r\n<html xmlns=\"http://www.w3.org/1999/xhtml\">\r\n<head>\r\n<meta http-equiv=\"Content-Type\" content=\"text/html; charset=iso-8859-1\"/>\r\n<title>404 - File or directory not found.</title>\r\n<style type=\"text/css\">\r\n<!--\r\nbody{margin:0;font-size:.7em;font-family:Verdana, Arial, Helvetica, sans-serif;background:#EEEEEE;}\r\nfieldset{padding:0 15px 10px 15px;} \r\nh1{font-size:2.4em;margin:0;color:#FFF;}\r\nh2{font-si" '\x00' '\x00'} error: invalid character '<' looking for beginning of value
STEP: Fetching activity logs took 29.720545079s
================ REDACTING LOGS ================
All sensitive variables are redacted
make: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure'
rm -rf bin .pkg_config testResults
make: Leaving directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure'
... skipping 12 lines ...