kubernetes/perf-tests PR #2051 soak-tests-capz-windows-2019 #1524056208816738304
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | oprinmarius: Apply Windows Exporter manifests after Prometheus Core Manifests |
| Result | ABORTED |
| Tests | 0 failed / 0 succeeded |
| Started | |
| Elapsed | 28m19s |
| Revision | 298fb3b315ae042ab2c7598e0c526aa62ba65c27 |
| Refs |
2051 |
... skipping 673 lines ... certificate.cert-manager.io "selfsigned-cert" deleted # Create secret for AzureClusterIdentity ./hack/create-identity-secret.sh make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' make[2]: Nothing to be done for 'kubectl'. make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Error from server (NotFound): secrets "cluster-identity-secret" not found secret/cluster-identity-secret created secret/cluster-identity-secret labeled # Deploy CAPI curl --retry 3 -sSL https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.1.2/cluster-api-components.yaml | /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/envsubst-v2.0.0-20210730161058-179042472c46 | kubectl apply -f - namespace/capi-system created customresourcedefinition.apiextensions.k8s.io/clusterclasses.cluster.x-k8s.io created ... skipping 124 lines ... # Wait for the kubeconfig to become available. timeout --foreground 300 bash -c "while ! kubectl get secrets | grep capz-0kwf54-kubeconfig; do sleep 1; done" capz-0kwf54-kubeconfig cluster.x-k8s.io/secret 1 1s # Get kubeconfig and store it locally. kubectl get secrets capz-0kwf54-kubeconfig -o json | jq -r .data.value | base64 --decode > ./kubeconfig timeout --foreground 600 bash -c "while ! kubectl --kubeconfig=./kubeconfig get nodes | grep control-plane; do sleep 1; done" error: the server doesn't have a resource type "nodes" capz-0kwf54-control-plane-45blh NotReady control-plane,master 6s v1.23.5 run "kubectl --kubeconfig=./kubeconfig ..." to work with the new target cluster make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Waiting for 1 control plane machine(s), 2 worker machine(s), and windows machine(s) to become Ready node/capz-0kwf54-control-plane-45blh condition met node/capz-0kwf54-md-0-75klf condition met ... skipping 47 lines ... go: downloading google.golang.org/grpc v1.36.0 go: downloading sigs.k8s.io/apiserver-network-proxy/konnectivity-client v0.0.22 go: downloading google.golang.org/genproto v0.0.0-20210312152112-fc591d9ea70f I0510 16:11:28.789693 27611 network_performance_measurement.go:87] Registering Network Performance Measurement I0510 16:11:29.321562 27611 clusterloader.go:152] ClusterConfig.Nodes set to 3 I0510 16:11:29.467194 27611 clusterloader.go:158] ClusterConfig.MasterName set to capz-0kwf54-control-plane-45blh E0510 16:11:29.612476 27611 clusterloader.go:169] Getting master external ip error: didn't find any ExternalIP master IPs I0510 16:11:29.757007 27611 clusterloader.go:176] ClusterConfig.MasterInternalIP set to [10.0.0.4] I0510 16:11:29.757079 27611 clusterloader.go:268] Using config: {ClusterConfig:{KubeConfigPath:/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig RunFromCluster:false Nodes:3 Provider:0xc000049920 EtcdCertificatePath:/etc/srv/kubernetes/pki/etcd-apiserver-server.crt EtcdKeyPath:/etc/srv/kubernetes/pki/etcd-apiserver-server.key EtcdInsecurePort:2382 MasterIPs:[] MasterInternalIPs:[10.0.0.4] MasterName:capz-0kwf54-control-plane-45blh DeleteStaleNamespaces:false DeleteAutomanagedNamespaces:true APIServerPprofByClientEnabled:true KubeletPort:10250 K8SClientsNumber:1 SkipClusterVerification:false} ReportDir:reports EnableExecService:true ModifierConfig:{OverwriteTestConfig:[] SkipSteps:[]} PrometheusConfig:{TearDownServer:true EnableServer:true EnablePushgateway:false ScrapeEtcd:false ScrapeNodeExporter:false ScrapeWindowsNodeExporter:true ScrapeKubelets:false ScrapeMasterKubelets:false ScrapeKubeProxy:true ScrapeKubeStateMetrics:false ScrapeMetricsServerMetrics:false ScrapeNodeLocalDNS:false ScrapeAnet:false ScrapeCiliumOperator:false APIServerScrapePort:443 SnapshotProject: ManifestPath:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests CoreManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/*.yaml DefaultServiceMonitors:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/default/*.yaml KubeStateMetricsManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/kube-state-metrics/*.yaml MasterIPServiceMonitors:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/*.yaml MetricsServerManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/metrics-server/*.yaml NodeExporterPod:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/node_exporter/node-exporter.yaml WindowsNodeExporterManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/windows_node_exporter/*.yaml PushgatewayManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/pushgateway/*.yaml StorageClassProvisioner:kubernetes.io/azure-disk StorageClassVolumeType:StandardSSD_LRS ReadyTimeout:15m0s} OverridePaths:[]} I0510 16:11:29.912401 27611 cluster.go:74] Listing cluster nodes: I0510 16:11:29.912464 27611 cluster.go:86] Name: capz-0kwf-cxgsr, clusterIP: 10.1.0.7, externalIP: , isSchedulable: false I0510 16:11:29.912473 27611 cluster.go:86] Name: capz-0kwf-jld27, clusterIP: 10.1.0.4, externalIP: , isSchedulable: false I0510 16:11:29.912478 27611 cluster.go:86] Name: capz-0kwf54-control-plane-45blh, clusterIP: 10.0.0.4, externalIP: , isSchedulable: true ... skipping 53 lines ... I0510 16:11:39.468844 27611 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/default/prometheus-serviceMonitorLegacyKubeDNS.yaml I0510 16:11:39.573644 27611 prometheus.go:327] Exposing kube-apiserver metrics in the cluster I0510 16:11:40.117158 27611 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-endpoints.yaml I0510 16:11:40.238331 27611 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-service.yaml I0510 16:11:40.343377 27611 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-serviceMonitor.yaml I0510 16:11:40.452116 27611 prometheus.go:406] Waiting for Prometheus stack to become healthy... W0510 16:12:10.555338 27611 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:12:40.555632 27611 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:13:10.557091 27611 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:13:40.555986 27611 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:14:10.555649 27611 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:14:40.556597 27611 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:15:10.556453 27611 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:15:40.555846 27611 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:16:10.555800 27611 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:16:40.556115 27611 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:17:25.558866 27611 util.go:72] error while calling prometheus api: Get "https://capz-0kwf54-f224a709.uksouth.cloudapp.azure.com:6443/api/v1/namespaces/monitoring/services/http:prometheus-k8s:9090/proxy/api/v1/targets": http2: client connection lost, response: (empty) W0510 16:18:10.453978 27611 util.go:72] error while calling prometheus api: Get "https://capz-0kwf54-f224a709.uksouth.cloudapp.azure.com:6443/api/v1/namespaces/monitoring/services/http:prometheus-k8s:9090/proxy/api/v1/targets": dial tcp 20.26.240.22:6443: i/o timeout, response: (empty) W0510 16:19:10.454174 27611 util.go:72] error while calling prometheus api: Get "https://capz-0kwf54-f224a709.uksouth.cloudapp.azure.com:6443/api/v1/namespaces/monitoring/services/http:prometheus-k8s:9090/proxy/api/v1/targets": dial tcp 20.26.240.22:6443: i/o timeout, response: (empty) W0510 16:20:10.453826 27611 util.go:72] error while calling prometheus api: Get "https://capz-0kwf54-f224a709.uksouth.cloudapp.azure.com:6443/api/v1/namespaces/monitoring/services/http:prometheus-k8s:9090/proxy/api/v1/targets": dial tcp 20.26.240.22:6443: i/o timeout, response: (empty) W0510 16:20:40.553830 27611 util.go:72] error while calling prometheus api: Get "https://capz-0kwf54-f224a709.uksouth.cloudapp.azure.com:6443/api/v1/namespaces/monitoring/services/http:prometheus-k8s:9090/proxy/api/v1/targets": dial tcp: lookup capz-0kwf54-f224a709.uksouth.cloudapp.azure.com on 10.63.240.10:53: no such host, response: (empty)