periodic-cluster-api-provider-vsphere-e2e-main #1618841438429122560
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 0 failed / 0 succeeded |
| Started | |
| Elapsed | 1h5m |
| Revision | main |
... skipping 176 lines ... #18 exporting to image #18 exporting layers #18 exporting layers 0.4s done #18 writing image sha256:dc7188e5d6880a95f0d1317973c6fa10437e00aa2ae6278b3ee9d0276544ec82 done #18 naming to gcr.io/k8s-staging-cluster-api/capv-manager:e2e done #18 DONE 0.4s WARNING: failed to get git remote url: fatal: No remote configured to list refs from. Activated service account credentials for: [capv-prow@cluster-api-provider-vsphere.iam.gserviceaccount.com] Copying file:///logs/artifacts/tempContainers/image.tar [Content-Type=application/x-tar]... / [0 files][ 0.0 B/ 74.6 MiB] - - [1 files][ 74.6 MiB/ 74.6 MiB] Operation completed over 1 objects/74.6 MiB. make -C /home/prow/go/src/sigs.k8s.io/cluster-api-provider-vsphere/hack/tools ginkgo make[1]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-vsphere/hack/tools' ... skipping 126 lines ... #18 exporting to image #18 exporting layers done #18 writing image sha256:dc7188e5d6880a95f0d1317973c6fa10437e00aa2ae6278b3ee9d0276544ec82 done #18 naming to gcr.io/k8s-staging-cluster-api/capv-manager:e2e done #18 DONE 0.0s WARNING: failed to get git remote url: fatal: No remote configured to list refs from. make release-manifests make[1]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-vsphere' make manifests STAGE=release MANIFEST_DIR=out PULL_POLICY=IfNotPresent IMAGE=gcr.io/cluster-api-provider-vsphere/release/manager:v1.6.0 make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-vsphere' make generate-flavors FLAVOR_DIR=out make[3]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-vsphere' ... skipping 320 lines ... INFO: Waiting for MachineDeployment rollout for MachineDeploymentTopology "md-0" (class "quick-start-worker") to complete. [1mSTEP:[0m Deleting a MachineDeploymentTopology in the Cluster Topology and wait for associated MachineDeployment to be deleted [38;5;243m@ 01/27/23 05:37:20.617[0m INFO: Removing MachineDeploymentTopology from the Cluster Topology. INFO: Waiting for MachineDeployment to be deleted. [1mSTEP:[0m PASSED! [38;5;243m@ 01/27/23 05:37:30.689[0m [1mSTEP:[0m Dumping logs from the "clusterclass-changes-adaix3" workload cluster [38;5;243m@ 01/27/23 05:37:30.689[0m Failed to get logs for Machine clusterclass-changes-adaix3-6m9wz-76vx6, Cluster clusterclass-changes-qnuplk/clusterclass-changes-adaix3: running command "cat /var/log/cloud-init-output.log": Process exited with status 1 [1mSTEP:[0m Dumping all the Cluster API resources in the "clusterclass-changes-qnuplk" namespace [38;5;243m@ 01/27/23 05:37:32.694[0m [1mSTEP:[0m Deleting cluster clusterclass-changes-qnuplk/clusterclass-changes-adaix3 [38;5;243m@ 01/27/23 05:37:32.99[0m [1mSTEP:[0m Deleting cluster clusterclass-changes-adaix3 [38;5;243m@ 01/27/23 05:37:33.01[0m INFO: Waiting for the Cluster clusterclass-changes-qnuplk/clusterclass-changes-adaix3 to be deleted [1mSTEP:[0m Waiting for cluster clusterclass-changes-adaix3 to be deleted [38;5;243m@ 01/27/23 05:37:33.024[0m [1mSTEP:[0m Deleting namespace used for hosting the "clusterclass-changes" test spec [38;5;243m@ 01/27/23 05:37:53.041[0m ... skipping 110 lines ... INFO: Waiting for rolling upgrade to start. INFO: Waiting for MachineDeployment rolling upgrade to start INFO: Waiting for rolling upgrade to complete. INFO: Waiting for MachineDeployment rolling upgrade to complete [1mSTEP:[0m PASSED! [38;5;243m@ 01/27/23 05:48:22.985[0m [1mSTEP:[0m Dumping logs from the "md-rollout-i6caif" workload cluster [38;5;243m@ 01/27/23 05:48:22.986[0m Failed to get logs for Machine md-rollout-i6caif-2rhlf, Cluster md-rollout-kqf5nh/md-rollout-i6caif: running command "cat /var/log/cloud-init-output.log": Process exited with status 1 Failed to get logs for Machine md-rollout-i6caif-md-0-8584d76d6d-x5vtk, Cluster md-rollout-kqf5nh/md-rollout-i6caif: running command "cat /var/log/cloud-init-output.log": Process exited with status 1 [1mSTEP:[0m Dumping all the Cluster API resources in the "md-rollout-kqf5nh" namespace [38;5;243m@ 01/27/23 05:48:27.297[0m [1mSTEP:[0m Deleting cluster md-rollout-kqf5nh/md-rollout-i6caif [38;5;243m@ 01/27/23 05:48:27.588[0m [1mSTEP:[0m Deleting cluster md-rollout-i6caif [38;5;243m@ 01/27/23 05:48:27.606[0m INFO: Waiting for the Cluster md-rollout-kqf5nh/md-rollout-i6caif to be deleted [1mSTEP:[0m Waiting for cluster md-rollout-i6caif to be deleted [38;5;243m@ 01/27/23 05:48:27.621[0m [1mSTEP:[0m Deleting namespace used for hosting the "md-rollout" test spec [38;5;243m@ 01/27/23 05:48:57.643[0m ... skipping 44 lines ... INFO: Waiting for the machine deployments to be provisioned [1mSTEP:[0m Waiting for the workload nodes to exist [38;5;243m@ 01/27/23 05:51:18.962[0m [1mSTEP:[0m Checking all the machines controlled by quick-start-q9bylx-md-0 are in the "<None>" failure domain [38;5;243m@ 01/27/23 05:52:19.049[0m INFO: Waiting for the machine pools to be provisioned [1mSTEP:[0m PASSED! [38;5;243m@ 01/27/23 05:52:19.097[0m [1mSTEP:[0m Dumping logs from the "quick-start-q9bylx" workload cluster [38;5;243m@ 01/27/23 05:52:19.097[0m Failed to get logs for Machine quick-start-q9bylx-md-0-fd8657974-lzl9x, Cluster quick-start-3n807i/quick-start-q9bylx: running command "cat /var/log/cloud-init-output.log": Process exited with status 1 Failed to get logs for Machine quick-start-q9bylx-tjcrm, Cluster quick-start-3n807i/quick-start-q9bylx: running command "cat /var/log/cloud-init-output.log": Process exited with status 1 [1mSTEP:[0m Dumping all the Cluster API resources in the "quick-start-3n807i" namespace [38;5;243m@ 01/27/23 05:52:23.462[0m [1mSTEP:[0m Deleting cluster quick-start-3n807i/quick-start-q9bylx [38;5;243m@ 01/27/23 05:52:23.775[0m [1mSTEP:[0m Deleting cluster quick-start-q9bylx [38;5;243m@ 01/27/23 05:52:23.795[0m INFO: Waiting for the Cluster quick-start-3n807i/quick-start-q9bylx to be deleted [1mSTEP:[0m Waiting for cluster quick-start-q9bylx to be deleted [38;5;243m@ 01/27/23 05:52:23.808[0m [1mSTEP:[0m Deleting namespace used for hosting the "quick-start" test spec [38;5;243m@ 01/27/23 05:52:53.829[0m ... skipping 44 lines ... INFO: Waiting for the machine deployments to be provisioned [1mSTEP:[0m Waiting for the workload nodes to exist [38;5;243m@ 01/27/23 05:55:25.345[0m [1mSTEP:[0m Checking all the machines controlled by quick-start-3qbf6o-md-0-mptpz are in the "<None>" failure domain [38;5;243m@ 01/27/23 05:56:45.453[0m INFO: Waiting for the machine pools to be provisioned [1mSTEP:[0m PASSED! [38;5;243m@ 01/27/23 05:56:45.496[0m [1mSTEP:[0m Dumping logs from the "quick-start-3qbf6o" workload cluster [38;5;243m@ 01/27/23 05:56:45.496[0m Failed to get logs for Machine quick-start-3qbf6o-8c4nj-bbr94, Cluster quick-start-1kgqpj/quick-start-3qbf6o: running command "cat /var/log/cloud-init-output.log": Process exited with status 1 Failed to get logs for Machine quick-start-3qbf6o-md-0-mptpz-7f7c5c7d6d-wp42n, Cluster quick-start-1kgqpj/quick-start-3qbf6o: running command "cat /var/log/cloud-init-output.log": Process exited with status 1 [1mSTEP:[0m Dumping all the Cluster API resources in the "quick-start-1kgqpj" namespace [38;5;243m@ 01/27/23 05:56:49.804[0m [1mSTEP:[0m Deleting cluster quick-start-1kgqpj/quick-start-3qbf6o [38;5;243m@ 01/27/23 05:56:50.108[0m [1mSTEP:[0m Deleting cluster quick-start-3qbf6o [38;5;243m@ 01/27/23 05:56:50.127[0m INFO: Waiting for the Cluster quick-start-1kgqpj/quick-start-3qbf6o to be deleted [1mSTEP:[0m Waiting for cluster quick-start-3qbf6o to be deleted [38;5;243m@ 01/27/23 05:56:50.146[0m [1mSTEP:[0m Deleting namespace used for hosting the "quick-start" test spec [38;5;243m@ 01/27/23 05:57:20.17[0m ... skipping 173 lines ... INFO: Waiting for correct number of replicas to exist [1mSTEP:[0m Scaling the MachineDeployment down to 1 [38;5;243m@ 01/27/23 06:14:09.284[0m INFO: Scaling machine deployment md-scale-79pe5r/md-scale-syi4mu-md-0 from 3 to 1 replicas INFO: Waiting for correct number of replicas to exist [1mSTEP:[0m PASSED! [38;5;243m@ 01/27/23 06:14:19.399[0m [1mSTEP:[0m Dumping logs from the "md-scale-syi4mu" workload cluster [38;5;243m@ 01/27/23 06:14:19.399[0m Failed to get logs for Machine md-scale-syi4mu-b5g2x, Cluster md-scale-79pe5r/md-scale-syi4mu: running command "cat /var/log/cloud-init-output.log": Process exited with status 1 Failed to get logs for Machine md-scale-syi4mu-md-0-7f7686df94-zx945, Cluster md-scale-79pe5r/md-scale-syi4mu: running command "cat /var/log/cloud-init-output.log": Process exited with status 1 [1mSTEP:[0m Dumping all the Cluster API resources in the "md-scale-79pe5r" namespace [38;5;243m@ 01/27/23 06:14:23.595[0m [1mSTEP:[0m Deleting cluster md-scale-79pe5r/md-scale-syi4mu [38;5;243m@ 01/27/23 06:14:23.938[0m [1mSTEP:[0m Deleting cluster md-scale-syi4mu [38;5;243m@ 01/27/23 06:14:23.957[0m INFO: Waiting for the Cluster md-scale-79pe5r/md-scale-syi4mu to be deleted [1mSTEP:[0m Waiting for cluster md-scale-syi4mu to be deleted [38;5;243m@ 01/27/23 06:14:23.971[0m [1mSTEP:[0m Deleting namespace used for hosting the "md-scale" test spec [38;5;243m@ 01/27/23 06:14:53.991[0m ... skipping 46 lines ... INFO: Waiting for the machine deployments to be provisioned [1mSTEP:[0m Waiting for the workload nodes to exist [38;5;243m@ 01/27/23 06:17:25.319[0m [1mSTEP:[0m Checking all the machines controlled by quick-start-t1j9qo-md-0 are in the "<None>" failure domain [38;5;243m@ 01/27/23 06:18:15.378[0m INFO: Waiting for the machine pools to be provisioned [1mSTEP:[0m PASSED! [38;5;243m@ 01/27/23 06:18:15.42[0m [1mSTEP:[0m Dumping logs from the "quick-start-t1j9qo" workload cluster [38;5;243m@ 01/27/23 06:18:15.42[0m Failed to get logs for Machine quick-start-t1j9qo-md-0-55b88cd859-7zwvb, Cluster quick-start-z4808e/quick-start-t1j9qo: dialing host IP address at 192.168.6.69: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain Failed to get logs for Machine quick-start-t1j9qo-s2n5m, Cluster quick-start-z4808e/quick-start-t1j9qo: dialing host IP address at 192.168.6.71: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain [1mSTEP:[0m Dumping all the Cluster API resources in the "quick-start-z4808e" namespace [38;5;243m@ 01/27/23 06:18:17.931[0m [1mSTEP:[0m Deleting cluster quick-start-z4808e/quick-start-t1j9qo [38;5;243m@ 01/27/23 06:18:18.206[0m [1mSTEP:[0m Deleting cluster quick-start-t1j9qo [38;5;243m@ 01/27/23 06:18:18.229[0m INFO: Waiting for the Cluster quick-start-z4808e/quick-start-t1j9qo to be deleted [1mSTEP:[0m Waiting for cluster quick-start-t1j9qo to be deleted [38;5;243m@ 01/27/23 06:18:18.242[0m [1mSTEP:[0m Deleting namespace used for hosting the "quick-start" test spec [38;5;243m@ 01/27/23 06:18:48.263[0m ... skipping 122 lines ... | for { [1m[38;5;214m> select {[0m | case <-ctx.Done(): | return [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchPodMetrics[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:225[0m | }, retryableOperationTimeout, retryableOperationInterval).Should(Succeed(), "Failed to list Pods for deployment %s", klog.KObj(input.Deployment)) | [1m[38;5;214m> go func() {[0m | defer GinkgoRecover() | for { [38;5;214mgoroutine 73690 [chan receive, 6 minutes][0m ... skipping 26 lines ... | for { [1m[38;5;214m> select {[0m | case <-ctx.Done(): | return [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchPodMetrics[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:225[0m | }, retryableOperationTimeout, retryableOperationInterval).Should(Succeed(), "Failed to list Pods for deployment %s", klog.KObj(input.Deployment)) | [1m[38;5;214m> go func() {[0m | defer GinkgoRecover() | for { [38;5;214mgoroutine 32302 [select, 2 minutes][0m ... skipping 3 lines ... | for { [1m[38;5;214m> select {[0m | case <-ctx.Done(): | return [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchPodMetrics[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:225[0m | }, retryableOperationTimeout, retryableOperationInterval).Should(Succeed(), "Failed to list Pods for deployment %s", klog.KObj(input.Deployment)) | [1m[38;5;214m> go func() {[0m | defer GinkgoRecover() | for { [38;5;214mgoroutine 32370 [sync.Cond.Wait][0m ... skipping 18 lines ... [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs.func2({{{0x0, 0x0}, {0x0, 0x0}}, {{0xc0025af650, 0x27}, {0xc0025af680, 0x22}, {0xc00205e500, 0xb}, ...}, ...}, ...)[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:186[0m | out := bufio.NewWriter(f) | defer out.Flush() [1m[38;5;214m> _, err = out.ReadFrom(podLogs)[0m | if err != nil && err != io.ErrUnexpectedEOF { | // Failing to stream logs should not cause the test to fail [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:161[0m | | // Watch each container's logs in a goroutine so we can stream them all concurrently. [1m[38;5;214m> go func(pod corev1.Pod, container corev1.Container) {[0m | defer GinkgoRecover() ... skipping 21 lines ... [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs.func2({{{0x0, 0x0}, {0x0, 0x0}}, {{0xc002477680, 0x3e}, {0xc0024776c0, 0x39}, {0xc0025aed80, 0x21}, ...}, ...}, ...)[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:186[0m | out := bufio.NewWriter(f) | defer out.Flush() [1m[38;5;214m> _, err = out.ReadFrom(podLogs)[0m | if err != nil && err != io.ErrUnexpectedEOF { | // Failing to stream logs should not cause the test to fail [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:161[0m | | // Watch each container's logs in a goroutine so we can stream them all concurrently. [1m[38;5;214m> go func(pod corev1.Pod, container corev1.Container) {[0m | defer GinkgoRecover() ... skipping 6 lines ... | for { [1m[38;5;214m> select {[0m | case <-ctx.Done(): | return [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchPodMetrics[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:225[0m | }, retryableOperationTimeout, retryableOperationInterval).Should(Succeed(), "Failed to list Pods for deployment %s", klog.KObj(input.Deployment)) | [1m[38;5;214m> go func() {[0m | defer GinkgoRecover() | for { [38;5;214mgoroutine 31711 [sync.Cond.Wait, 6 minutes][0m ... skipping 18 lines ... [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs.func2({{{0x0, 0x0}, {0x0, 0x0}}, {{0xc000cc5200, 0x3a}, {0xc000cc5240, 0x35}, {0xc0011d5360, 0x1d}, ...}, ...}, ...)[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:186[0m | out := bufio.NewWriter(f) | defer out.Flush() [1m[38;5;214m> _, err = out.ReadFrom(podLogs)[0m | if err != nil && err != io.ErrUnexpectedEOF { | // Failing to stream logs should not cause the test to fail [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:161[0m | | // Watch each container's logs in a goroutine so we can stream them all concurrently. [1m[38;5;214m> go func(pod corev1.Pod, container corev1.Container) {[0m | defer GinkgoRecover() ... skipping 21 lines ... [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs.func2({{{0x0, 0x0}, {0x0, 0x0}}, {{0xc002554390, 0x28}, {0xc0025543c0, 0x23}, {0xc0020bc504, 0xb}, ...}, ...}, ...)[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:186[0m | out := bufio.NewWriter(f) | defer out.Flush() [1m[38;5;214m> _, err = out.ReadFrom(podLogs)[0m | if err != nil && err != io.ErrUnexpectedEOF { | // Failing to stream logs should not cause the test to fail [38;5;214m[1m> sigs.k8s.io/cluster-api/test/framework.WatchDeploymentLogs[0m [38;5;214m[1m/home/prow/go/pkg/mod/sigs.k8s.io/cluster-api/test@v1.3.0/framework/deployment_helpers.go:161[0m | | // Watch each container's logs in a goroutine so we can stream them all concurrently. [1m[38;5;214m> go func(pod corev1.Pod, container corev1.Container) {[0m | defer GinkgoRecover() ... skipping 16 lines ... [38;5;9m[1mSummarizing 1 Failure:[0m [38;5;214m[TIMEDOUT][0m [0mCluster creation with storage policy [38;5;214m[1m[It] should create a cluster successfully[0m [38;5;243m/home/prow/go/src/sigs.k8s.io/cluster-api-provider-vsphere/test/e2e/storage_policy_test.go:57[0m [38;5;9m[1mRan 11 of 17 Specs in 3577.085 seconds[0m [38;5;9m[1mFAIL! - Suite Timeout Elapsed[0m -- [38;5;10m[1m10 Passed[0m | [38;5;9m[1m1 Failed[0m | [38;5;11m[1m1 Pending[0m | [38;5;14m[1m5 Skipped[0m --- FAIL: TestE2E (3577.09s) FAIL Ginkgo ran 1 suite in 1h0m31.568261604s Test Suite Failed real 60m31.588s user 5m44.328s sys 1m7.327s make: *** [Makefile:183: e2e] Error 1 Releasing IP claims ipclaim.ipam.metal3.io "ip-claim-7d5df2d671940b3991c21d6a34bc441cb181d5ba" deleted ipclaim.ipam.metal3.io "workload-ip-claim-7c85de91285bc2e5f2441a9d1ee3942f083101e2" deleted vpn WARNING: [capv-prow@cluster-api-provider-vsphere.iam.gserviceaccount.com] appears to be a service account. Service account tokens cannot be revoked, but they will expire automatically. To prevent use of the service account token earlier than the expiration, delete or disable the parent service account. To explicitly delete the key associated with the service account use `gcloud iam service-accounts keys delete` instead`. Revoked credentials: ... skipping 13 lines ...