kubernetes/perf-tests PR #2051 soak-tests-capz-windows-2019 #1524156912071872512
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | oprinmarius: Apply Windows Exporter manifests after Prometheus Core Manifests |
| Result | FAILURE |
| Tests | 0 failed / 0 succeeded |
| Started | |
| Elapsed | 37m7s |
| Revision | 298fb3b315ae042ab2c7598e0c526aa62ba65c27 |
| Refs |
2051 |
... skipping 676 lines ... certificate.cert-manager.io "selfsigned-cert" deleted # Create secret for AzureClusterIdentity ./hack/create-identity-secret.sh make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' make[2]: Nothing to be done for 'kubectl'. make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Error from server (NotFound): secrets "cluster-identity-secret" not found secret/cluster-identity-secret created secret/cluster-identity-secret labeled # Deploy CAPI curl --retry 3 -sSL https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.1.2/cluster-api-components.yaml | /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/envsubst-v2.0.0-20210730161058-179042472c46 | kubectl apply -f - namespace/capi-system created customresourcedefinition.apiextensions.k8s.io/clusterclasses.cluster.x-k8s.io created ... skipping 132 lines ... # Wait for the kubeconfig to become available. timeout --foreground 300 bash -c "while ! kubectl get secrets | grep capz-bix4sd-kubeconfig; do sleep 1; done" capz-bix4sd-kubeconfig cluster.x-k8s.io/secret 1 1s # Get kubeconfig and store it locally. kubectl get secrets capz-bix4sd-kubeconfig -o json | jq -r .data.value | base64 --decode > ./kubeconfig timeout --foreground 600 bash -c "while ! kubectl --kubeconfig=./kubeconfig get nodes | grep control-plane; do sleep 1; done" error: the server doesn't have a resource type "nodes" capz-bix4sd-control-plane-dhn5h NotReady control-plane,master 9s v1.23.5 run "kubectl --kubeconfig=./kubeconfig ..." to work with the new target cluster make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Waiting for 1 control plane machine(s), 2 worker machine(s), and 2 windows machine(s) to become Ready node/capz-bix4-btnbg condition met node/capz-bix4-v6jtj condition met ... skipping 50 lines ... go: downloading google.golang.org/grpc v1.36.0 go: downloading sigs.k8s.io/apiserver-network-proxy/konnectivity-client v0.0.22 go: downloading google.golang.org/genproto v0.0.0-20210312152112-fc591d9ea70f I0510 22:53:38.310535 27868 network_performance_measurement.go:87] Registering Network Performance Measurement I0510 22:53:38.517267 27868 clusterloader.go:152] ClusterConfig.Nodes set to 5 I0510 22:53:38.563104 27868 clusterloader.go:158] ClusterConfig.MasterName set to capz-bix4sd-control-plane-dhn5h E0510 22:53:38.607742 27868 clusterloader.go:169] Getting master external ip error: didn't find any ExternalIP master IPs I0510 22:53:38.652062 27868 clusterloader.go:176] ClusterConfig.MasterInternalIP set to [10.0.0.4] I0510 22:53:38.652117 27868 clusterloader.go:268] Using config: {ClusterConfig:{KubeConfigPath:/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig RunFromCluster:false Nodes:5 Provider:0xc000141a70 EtcdCertificatePath:/etc/srv/kubernetes/pki/etcd-apiserver-server.crt EtcdKeyPath:/etc/srv/kubernetes/pki/etcd-apiserver-server.key EtcdInsecurePort:2382 MasterIPs:[] MasterInternalIPs:[10.0.0.4] MasterName:capz-bix4sd-control-plane-dhn5h DeleteStaleNamespaces:false DeleteAutomanagedNamespaces:true APIServerPprofByClientEnabled:false KubeletPort:10250 K8SClientsNumber:1 SkipClusterVerification:false} ReportDir:reports EnableExecService:true ModifierConfig:{OverwriteTestConfig:[] SkipSteps:[]} PrometheusConfig:{TearDownServer:true EnableServer:true EnablePushgateway:false ScrapeEtcd:false ScrapeNodeExporter:false ScrapeWindowsNodeExporter:true ScrapeKubelets:false ScrapeMasterKubelets:false ScrapeKubeProxy:true ScrapeKubeStateMetrics:false ScrapeMetricsServerMetrics:false ScrapeNodeLocalDNS:false ScrapeAnet:false ScrapeCiliumOperator:false APIServerScrapePort:6443 SnapshotProject: ManifestPath:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests CoreManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/*.yaml DefaultServiceMonitors:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/default/*.yaml KubeStateMetricsManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/kube-state-metrics/*.yaml MasterIPServiceMonitors:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/*.yaml MetricsServerManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/metrics-server/*.yaml NodeExporterPod:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/node_exporter/node-exporter.yaml WindowsNodeExporterManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/windows_node_exporter/*.yaml PushgatewayManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/pushgateway/*.yaml StorageClassProvisioner:kubernetes.io/azure-disk StorageClassVolumeType:StandardSSD_LRS ReadyTimeout:15m0s} OverridePaths:[]} I0510 22:53:38.696522 27868 cluster.go:74] Listing cluster nodes: I0510 22:53:38.696555 27868 cluster.go:86] Name: capz-bix4-btnbg, clusterIP: 10.1.0.5, externalIP: , isSchedulable: true I0510 22:53:38.696563 27868 cluster.go:86] Name: capz-bix4-v6jtj, clusterIP: 10.1.0.6, externalIP: , isSchedulable: true I0510 22:53:38.696568 27868 cluster.go:86] Name: capz-bix4sd-control-plane-dhn5h, clusterIP: 10.0.0.4, externalIP: , isSchedulable: true ... skipping 53 lines ... I0510 22:53:43.924572 27868 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/default/prometheus-serviceMonitorLegacyKubeDNS.yaml I0510 22:53:43.954337 27868 prometheus.go:327] Exposing kube-apiserver metrics in the cluster I0510 22:53:44.147903 27868 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-endpoints.yaml I0510 22:53:44.177584 27868 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-service.yaml I0510 22:53:44.206389 27868 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-serviceMonitor.yaml I0510 22:53:44.235728 27868 prometheus.go:406] Waiting for Prometheus stack to become healthy... W0510 22:54:14.268266 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 22:54:44.268667 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 22:55:14.267700 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 22:55:44.269201 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 22:56:14.269132 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 22:56:44.268366 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 22:57:14.267648 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 22:57:44.268703 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 22:58:14.268550 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 22:58:44.267503 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 22:59:14.268470 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 22:59:44.268782 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:00:14.268689 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:00:44.267690 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:01:14.268156 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:01:44.267683 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:02:14.268316 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:02:44.267866 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:03:14.267963 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:03:44.267826 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:04:14.268143 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:04:44.272685 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:05:14.268347 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:05:44.267838 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:06:14.267653 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:06:44.267404 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:07:14.268328 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:07:44.267856 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:08:14.268701 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:08:44.272955 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 23:08:44.304098 27868 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " I0510 23:08:44.304144 27868 prometheus.go:454] Dumping monitoring/prometheus-k8s events... I0510 23:08:44.336528 27868 prometheus.go:465] { ... skipping 100 lines ... "eventTime": null, "reportingComponent": "", "reportingInstance": "" } ] } F0510 23:08:44.336579 27868 clusterloader.go:300] Error while setting up prometheus stack: timed out waiting for the condition exit status 1 make: Nothing to be done for 'kubectl'. ================ DUMPING LOGS FOR MANAGEMENT CLUSTER ================ Exported logs for cluster "capz" to: /logs/artifacts/management-cluster ================ DUMPING LOGS FOR WORKLOAD CLUSTER (Linux) ========== ... skipping 104 lines ...