This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2023-01-24 17:19
Elapsed1h5m
Revisionmain

No Test Failures!


Error lines from build-log.txt

... skipping 594 lines ...
  Patching MachineHealthCheck unhealthy condition to one of the nodes
  INFO: Patching the node condition to the node
  Waiting for remediation
  Waiting until the node with unhealthy node condition is remediated
  STEP: PASSED! @ 01/24/23 17:34:46.632
  STEP: Dumping logs from the "mhc-remediation-vjmcia" workload cluster @ 01/24/23 17:34:46.633
Failed to get logs for Machine mhc-remediation-vjmcia-md-0-84c889558b-qjk2d, Cluster mhc-remediation-q4u0kx/mhc-remediation-vjmcia: running command "cat /var/log/cloud-init-output.log": Process exited with status 1
Failed to get logs for Machine mhc-remediation-vjmcia-t8lk4, Cluster mhc-remediation-q4u0kx/mhc-remediation-vjmcia: running command "cat /var/log/cloud-init-output.log": Process exited with status 1
  STEP: Dumping all the Cluster API resources in the "mhc-remediation-q4u0kx" namespace @ 01/24/23 17:34:51.078
  STEP: Deleting cluster mhc-remediation-q4u0kx/mhc-remediation-vjmcia @ 01/24/23 17:34:51.418
  STEP: Deleting cluster mhc-remediation-vjmcia @ 01/24/23 17:34:51.44
  INFO: Waiting for the Cluster mhc-remediation-q4u0kx/mhc-remediation-vjmcia to be deleted
  STEP: Waiting for cluster mhc-remediation-vjmcia to be deleted @ 01/24/23 17:34:51.455
  STEP: Deleting namespace used for hosting the "mhc-remediation" test spec @ 01/24/23 17:35:31.483
... skipping 35 lines ...

  INFO: Waiting for the cluster infrastructure to be provisioned
  STEP: Waiting for cluster to enter the provisioned phase @ 01/24/23 17:35:32.863
  INFO: Waiting for control plane to be initialized
  INFO: Waiting for the first control plane machine managed by mhc-remediation-oayt9w/mhc-remediation-h7okh2 to be provisioned
  STEP: Waiting for one control plane node to exist @ 01/24/23 17:36:22.914
  [FAILED] in [It] - /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154 @ 01/24/23 17:46:22.916
  STEP: Dumping logs from the "mhc-remediation-h7okh2" workload cluster @ 01/24/23 17:46:22.916
Failed to get logs for Machine mhc-remediation-h7okh2-46prm, Cluster mhc-remediation-oayt9w/mhc-remediation-h7okh2: running command "cat /var/log/cloud-init-output.log": Process exited with status 1
Failed to get logs for Machine mhc-remediation-h7okh2-md-0-5f688c776-4jpvc, Cluster mhc-remediation-oayt9w/mhc-remediation-h7okh2: dialing host IP address at : dial tcp :22: connect: connection refused
  STEP: Dumping all the Cluster API resources in the "mhc-remediation-oayt9w" namespace @ 01/24/23 17:46:25.152
  STEP: Deleting cluster mhc-remediation-oayt9w/mhc-remediation-h7okh2 @ 01/24/23 17:46:25.445
  STEP: Deleting cluster mhc-remediation-h7okh2 @ 01/24/23 17:46:25.466
  INFO: Waiting for the Cluster mhc-remediation-oayt9w/mhc-remediation-h7okh2 to be deleted
  STEP: Waiting for cluster mhc-remediation-h7okh2 to be deleted @ 01/24/23 17:46:25.479
  STEP: Deleting namespace used for hosting the "mhc-remediation" test spec @ 01/24/23 17:46:45.497
  INFO: Deleting namespace mhc-remediation-oayt9w
• [FAILED] [674.013 seconds]
When testing unhealthy machines remediation [It] Should successfully trigger KCP remediation
/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/e2e/mhc_remediations.go:116

  [FAILED] Timed out after 600.001s.
  No Control Plane machines came into existence. 
  Expected
      <bool>: false
  to be true
  In [It] at: /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154 @ 01/24/23 17:46:22.916
------------------------------
... skipping 31 lines ...

  INFO: Waiting for the cluster infrastructure to be provisioned
  STEP: Waiting for cluster to enter the provisioned phase @ 01/24/23 17:46:46.689
  INFO: Waiting for control plane to be initialized
  INFO: Waiting for the first control plane machine managed by md-scale-f82pcd/md-scale-uclkot to be provisioned
  STEP: Waiting for one control plane node to exist @ 01/24/23 17:47:36.741
  [FAILED] in [It] - /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154 @ 01/24/23 17:57:36.742
  STEP: Dumping logs from the "md-scale-uclkot" workload cluster @ 01/24/23 17:57:36.742
Failed to get logs for Machine md-scale-uclkot-5vk9q, Cluster md-scale-f82pcd/md-scale-uclkot: running command "cat /var/log/cloud-init-output.log": Process exited with status 1
Failed to get logs for Machine md-scale-uclkot-md-0-69cf748df9-9svld, Cluster md-scale-f82pcd/md-scale-uclkot: dialing host IP address at : dial tcp :22: connect: connection refused
  STEP: Dumping all the Cluster API resources in the "md-scale-f82pcd" namespace @ 01/24/23 17:57:39.033
  STEP: Deleting cluster md-scale-f82pcd/md-scale-uclkot @ 01/24/23 17:57:39.328
  STEP: Deleting cluster md-scale-uclkot @ 01/24/23 17:57:39.346
  INFO: Waiting for the Cluster md-scale-f82pcd/md-scale-uclkot to be deleted
  STEP: Waiting for cluster md-scale-uclkot to be deleted @ 01/24/23 17:57:39.365
  STEP: Deleting namespace used for hosting the "md-scale" test spec @ 01/24/23 17:57:59.38
  INFO: Deleting namespace md-scale-f82pcd
• [FAILED] [673.886 seconds]
When testing MachineDeployment scale out/in [It] Should successfully scale a MachineDeployment up and down upon changes to the MachineDeployment replica count
/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/e2e/md_scale.go:71

  [FAILED] Timed out after 600.001s.
  No Control Plane machines came into existence. 
  Expected
      <bool>: false
  to be true
  In [It] at: /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154 @ 01/24/23 17:57:36.742
------------------------------
... skipping 33 lines ...

  INFO: Waiting for the cluster infrastructure to be provisioned
  STEP: Waiting for cluster to enter the provisioned phase @ 01/24/23 17:58:00.586
  INFO: Waiting for control plane to be initialized
  INFO: Waiting for the first control plane machine managed by dhcp-overrides-wlc1ts/dhcp-overrides-fx84w5 to be provisioned
  STEP: Waiting for one control plane node to exist @ 01/24/23 17:58:50.643
  [FAILED] in [It] - /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154 @ 01/24/23 18:08:50.645
  STEP: Dumping all the Cluster API resources in the "dhcp-overrides-wlc1ts" namespace @ 01/24/23 18:08:50.645
  STEP: cleaning up namespace: dhcp-overrides-wlc1ts @ 01/24/23 18:08:50.95
  STEP: Deleting cluster dhcp-overrides-fx84w5 @ 01/24/23 18:08:50.97
  INFO: Waiting for the Cluster dhcp-overrides-wlc1ts/dhcp-overrides-fx84w5 to be deleted
  STEP: Waiting for cluster dhcp-overrides-fx84w5 to be deleted @ 01/24/23 18:08:50.984
  STEP: Deleting namespace used for hosting test spec @ 01/24/23 18:09:10.999
  INFO: Deleting namespace dhcp-overrides-wlc1ts
• [FAILED] [671.621 seconds]
DHCPOverrides configuration test when Creating a cluster with DHCPOverrides configured [It] Only configures the network with the provided nameservers
/home/prow/go/src/sigs.k8s.io/cluster-api-provider-vsphere/test/e2e/dhcp_overrides_test.go:66

  [FAILED] Timed out after 600.001s.
  No Control Plane machines came into existence. 
  Expected
      <bool>: false
  to be true
  In [It] at: /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154 @ 01/24/23 18:08:50.645
------------------------------
... skipping 31 lines ...

  INFO: Waiting for the cluster infrastructure to be provisioned
  STEP: Waiting for cluster to enter the provisioned phase @ 01/24/23 18:09:12.175
  INFO: Waiting for control plane to be initialized
  INFO: Waiting for the first control plane machine managed by quick-start-yfeifn/quick-start-4c2hsl to be provisioned
  STEP: Waiting for one control plane node to exist @ 01/24/23 18:09:32.216
  [FAILED] in [It] - /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154 @ 01/24/23 18:19:32.219
  STEP: Dumping logs from the "quick-start-4c2hsl" workload cluster @ 01/24/23 18:19:32.22
Failed to get logs for Machine quick-start-4c2hsl-md-0-d7f7c8845-8xx4j, Cluster quick-start-yfeifn/quick-start-4c2hsl: dialing host IP address at : dial tcp :22: connect: connection refused
Failed to get logs for Machine quick-start-4c2hsl-p6mvf, Cluster quick-start-yfeifn/quick-start-4c2hsl: dialing host IP address at 192.168.6.151: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
  STEP: Dumping all the Cluster API resources in the "quick-start-yfeifn" namespace @ 01/24/23 18:19:33.558
  STEP: Deleting cluster quick-start-yfeifn/quick-start-4c2hsl @ 01/24/23 18:19:33.86
  STEP: Deleting cluster quick-start-4c2hsl @ 01/24/23 18:19:33.88
  INFO: Waiting for the Cluster quick-start-yfeifn/quick-start-4c2hsl to be deleted
  STEP: Waiting for cluster quick-start-4c2hsl to be deleted @ 01/24/23 18:19:33.895
  STEP: Deleting namespace used for hosting the "quick-start" test spec @ 01/24/23 18:19:53.91
  INFO: Deleting namespace quick-start-yfeifn
• [FAILED] [642.907 seconds]
Cluster creation with [Ignition] bootstrap [PR-Blocking] [It] Should create a workload cluster
/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/e2e/quick_start.go:78

  [FAILED] Timed out after 600.003s.
  No Control Plane machines came into existence. 
  Expected
      <bool>: false
  to be true
  In [It] at: /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154 @ 01/24/23 18:19:32.219
------------------------------
... skipping 33 lines ...
  STEP: Waiting for cluster to enter the provisioned phase @ 01/24/23 18:19:55.134
  INFO: Waiting for control plane to be initialized
  INFO: Waiting for the first control plane machine managed by quick-start-5garco/quick-start-rdun14-r9tlq to be provisioned
  STEP: Waiting for one control plane node to exist @ 01/24/23 18:20:15.197
  [TIMEDOUT] in [It] - /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/e2e/quick_start.go:78 @ 01/24/23 18:24:06.7
  STEP: Dumping logs from the "quick-start-rdun14" workload cluster @ 01/24/23 18:24:06.702
Failed to get logs for Machine quick-start-rdun14-md-0-x6x6m-687c7479d9-6rfbn, Cluster quick-start-5garco/quick-start-rdun14: dialing host IP address at : dial tcp :22: connect: connection refused
Failed to get logs for Machine quick-start-rdun14-r9tlq-bmqvt, Cluster quick-start-5garco/quick-start-rdun14: running command "cat /var/log/cloud-init-output.log": Process exited with status 1
  STEP: Dumping all the Cluster API resources in the "quick-start-5garco" namespace @ 01/24/23 18:24:08.843
  STEP: Deleting cluster quick-start-5garco/quick-start-rdun14 @ 01/24/23 18:24:09.152
  STEP: Deleting cluster quick-start-rdun14 @ 01/24/23 18:24:09.177
  INFO: Waiting for the Cluster quick-start-5garco/quick-start-rdun14 to be deleted
  STEP: Waiting for cluster quick-start-rdun14 to be deleted @ 01/24/23 18:24:09.193
  STEP: Deleting namespace used for hosting the "quick-start" test spec @ 01/24/23 18:24:29.212
... skipping 84 lines ...
        > sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs.func2({{{0x0, 0x0}, {0x0, 0x0}}, {{0xc0015aee00, 0x3a}, {0xc0015aee40, 0x35}, {0xc0015aabc0, 0x1d}, ...}, ...}, ...)
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:186
              | out := bufio.NewWriter(f)
              | defer out.Flush()
              > _, err = out.ReadFrom(podLogs)
              | if err != nil && err != io.ErrUnexpectedEOF {
              | 	// Failing to stream logs should not cause the test to fail
        > sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:161
              | 
              | // Watch each container's logs in a goroutine so we can stream them all concurrently.
              > go func(pod corev1.Pod, container corev1.Container) {
              | 	defer GinkgoRecover()
... skipping 21 lines ...
        > sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs.func2({{{0x0, 0x0}, {0x0, 0x0}}, {{0xc000b78680, 0x3e}, {0xc000b786c0, 0x39}, {0xc002173bf0, 0x21}, ...}, ...}, ...)
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:186
              | out := bufio.NewWriter(f)
              | defer out.Flush()
              > _, err = out.ReadFrom(podLogs)
              | if err != nil && err != io.ErrUnexpectedEOF {
              | 	// Failing to stream logs should not cause the test to fail
        > sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:161
              | 
              | // Watch each container's logs in a goroutine so we can stream them all concurrently.
              > go func(pod corev1.Pod, container corev1.Container) {
              | 	defer GinkgoRecover()
... skipping 21 lines ...
        > sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs.func2({{{0x0, 0x0}, {0x0, 0x0}}, {{0xc0022dd5c0, 0x27}, {0xc0022dd5f0, 0x22}, {0xc00202ddd4, 0xb}, ...}, ...}, ...)
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:186
              | out := bufio.NewWriter(f)
              | defer out.Flush()
              > _, err = out.ReadFrom(podLogs)
              | if err != nil && err != io.ErrUnexpectedEOF {
              | 	// Failing to stream logs should not cause the test to fail
        > sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:161
              | 
              | // Watch each container's logs in a goroutine so we can stream them all concurrently.
              > go func(pod corev1.Pod, container corev1.Container) {
              | 	defer GinkgoRecover()
... skipping 44 lines ...
        > sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs.func2({{{0x0, 0x0}, {0x0, 0x0}}, {{0xc0020ab620, 0x28}, {0xc0020ab650, 0x23}, {0xc002bad790, 0xb}, ...}, ...}, ...)
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:186
              | out := bufio.NewWriter(f)
              | defer out.Flush()
              > _, err = out.ReadFrom(podLogs)
              | if err != nil && err != io.ErrUnexpectedEOF {
              | 	// Failing to stream logs should not cause the test to fail
        > sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:161
              | 
              | // Watch each container's logs in a goroutine so we can stream them all concurrently.
              > go func(pod corev1.Pod, container corev1.Container) {
              | 	defer GinkgoRecover()
... skipping 6 lines ...
              | for {
              > 	select {
              | 	case <-ctx.Done():
              | 		return
        > sigs.k8s.io/cluster-api/test/framework.WatchPodMetrics
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:225
              | }, retryableOperationTimeout, retryableOperationInterval).Should(Succeed(), "Failed to list Pods for deployment %s", klog.KObj(input.Deployment))
              | 
              > go func() {
              | 	defer GinkgoRecover()
              | 	for {

        goroutine 33323 [select]
... skipping 3 lines ...
              | for {
              > 	select {
              | 	case <-ctx.Done():
              | 		return
        > sigs.k8s.io/cluster-api/test/framework.WatchPodMetrics
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:225
              | }, retryableOperationTimeout, retryableOperationInterval).Should(Succeed(), "Failed to list Pods for deployment %s", klog.KObj(input.Deployment))
              | 
              > go func() {
              | 	defer GinkgoRecover()
              | 	for {

        goroutine 33346 [select]
... skipping 3 lines ...
              | for {
              > 	select {
              | 	case <-ctx.Done():
              | 		return
        > sigs.k8s.io/cluster-api/test/framework.WatchPodMetrics
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:225
              | }, retryableOperationTimeout, retryableOperationInterval).Should(Succeed(), "Failed to list Pods for deployment %s", klog.KObj(input.Deployment))
              | 
              > go func() {
              | 	defer GinkgoRecover()
              | 	for {

        goroutine 33260 [select]
... skipping 3 lines ...
              | for {
              > 	select {
              | 	case <-ctx.Done():
              | 		return
        > sigs.k8s.io/cluster-api/test/framework.WatchPodMetrics
            /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:225
              | }, retryableOperationTimeout, retryableOperationInterval).Should(Succeed(), "Failed to list Pods for deployment %s", klog.KObj(input.Deployment))
              | 
              > go func() {
              | 	defer GinkgoRecover()
              | 	for {
------------------------------
S
... skipping 8 lines ...
  STEP: Cleaning up the vSphere session @ 01/24/23 18:24:29.232
  STEP: Tearing down the management cluster @ 01/24/23 18:24:29.452
[SynchronizedAfterSuite] PASSED [1.533 seconds]
------------------------------

Summarizing 5 Failures:
  [FAIL] When testing unhealthy machines remediation [It] Should successfully trigger KCP remediation
  /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154
  [FAIL] When testing MachineDeployment scale out/in [It] Should successfully scale a MachineDeployment up and down upon changes to the MachineDeployment replica count
  /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154
  [FAIL] DHCPOverrides configuration test when Creating a cluster with DHCPOverrides configured [It] Only configures the network with the provided nameservers
  /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154
  [FAIL] Cluster creation with [Ignition] bootstrap [PR-Blocking] [It] Should create a workload cluster
  /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/controlplane_helpers.go:154
  [TIMEDOUT] ClusterClass Creation using Cluster API quick-start test [PR-Blocking] [ClusterClass] [It] Should create a workload cluster
  /home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/e2e/quick_start.go:78

Ran 6 of 17 Specs in 3569.230 seconds
FAIL! - Suite Timeout Elapsed -- 1 Passed | 5 Failed | 1 Pending | 10 Skipped
--- FAIL: TestE2E (3569.23s)
FAIL

Ginkgo ran 1 suite in 1h0m24.181139279s

Test Suite Failed

real	60m24.208s
user	5m46.247s
sys	1m9.742s
make: *** [Makefile:183: e2e] Error 1
Releasing IP claims
ipclaim.ipam.metal3.io "ip-claim-7cefa2ef5d01a99049414a9d1258a5c700549056" deleted
ipclaim.ipam.metal3.io "workload-ip-claim-da659fd3b57d3ad3eef0634a2968711bd1d6830f" deleted
vpn
WARNING: [capv-prow@cluster-api-provider-vsphere.iam.gserviceaccount.com] appears to be a service account. Service account tokens cannot be revoked, but they will expire automatically. To prevent use of the service account token earlier than the expiration, delete or disable the parent service account. To explicitly delete the key associated with the service account use `gcloud iam service-accounts keys delete` instead`.
Revoked credentials:
... skipping 13 lines ...