kubernetes/perf-tests PR #2051 soak-tests-capz-windows-2019 #1524061947887095808
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | oprinmarius: Apply Windows Exporter manifests after Prometheus Core Manifests |
| Result | FAILURE |
| Tests | 0 failed / 0 succeeded |
| Started | |
| Elapsed | 36m15s |
| Revision | 298fb3b315ae042ab2c7598e0c526aa62ba65c27 |
| Refs |
2051 |
... skipping 673 lines ... certificate.cert-manager.io "selfsigned-cert" deleted # Create secret for AzureClusterIdentity ./hack/create-identity-secret.sh make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' make[2]: Nothing to be done for 'kubectl'. make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Error from server (NotFound): secrets "cluster-identity-secret" not found secret/cluster-identity-secret created secret/cluster-identity-secret labeled # Deploy CAPI curl --retry 3 -sSL https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.1.2/cluster-api-components.yaml | /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/envsubst-v2.0.0-20210730161058-179042472c46 | kubectl apply -f - namespace/capi-system created customresourcedefinition.apiextensions.k8s.io/clusterclasses.cluster.x-k8s.io created ... skipping 124 lines ... # Wait for the kubeconfig to become available. timeout --foreground 300 bash -c "while ! kubectl get secrets | grep capz-arhnvk-kubeconfig; do sleep 1; done" capz-arhnvk-kubeconfig cluster.x-k8s.io/secret 1 1s # Get kubeconfig and store it locally. kubectl get secrets capz-arhnvk-kubeconfig -o json | jq -r .data.value | base64 --decode > ./kubeconfig timeout --foreground 600 bash -c "while ! kubectl --kubeconfig=./kubeconfig get nodes | grep control-plane; do sleep 1; done" error: the server doesn't have a resource type "nodes" No resources found capz-arhnvk-control-plane-l8bn6 NotReady <none> 1s v1.23.5 run "kubectl --kubeconfig=./kubeconfig ..." to work with the new target cluster make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Waiting for 1 control plane machine(s), 2 worker machine(s), and windows machine(s) to become Ready node/capz-arhnvk-control-plane-l8bn6 condition met ... skipping 47 lines ... go: downloading google.golang.org/grpc v1.36.0 go: downloading sigs.k8s.io/apiserver-network-proxy/konnectivity-client v0.0.22 go: downloading google.golang.org/genproto v0.0.0-20210312152112-fc591d9ea70f I0510 16:34:19.156008 27457 network_performance_measurement.go:87] Registering Network Performance Measurement I0510 16:34:19.339041 27457 clusterloader.go:152] ClusterConfig.Nodes set to 3 I0510 16:34:19.378235 27457 clusterloader.go:158] ClusterConfig.MasterName set to capz-arhnvk-control-plane-l8bn6 E0510 16:34:19.417248 27457 clusterloader.go:169] Getting master external ip error: didn't find any ExternalIP master IPs I0510 16:34:19.455951 27457 clusterloader.go:176] ClusterConfig.MasterInternalIP set to [10.0.0.4] I0510 16:34:19.456113 27457 clusterloader.go:268] Using config: {ClusterConfig:{KubeConfigPath:/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig RunFromCluster:false Nodes:3 Provider:0xc000440880 EtcdCertificatePath:/etc/srv/kubernetes/pki/etcd-apiserver-server.crt EtcdKeyPath:/etc/srv/kubernetes/pki/etcd-apiserver-server.key EtcdInsecurePort:2382 MasterIPs:[] MasterInternalIPs:[10.0.0.4] MasterName:capz-arhnvk-control-plane-l8bn6 DeleteStaleNamespaces:false DeleteAutomanagedNamespaces:true APIServerPprofByClientEnabled:false KubeletPort:10250 K8SClientsNumber:1 SkipClusterVerification:false} ReportDir:reports EnableExecService:true ModifierConfig:{OverwriteTestConfig:[] SkipSteps:[]} PrometheusConfig:{TearDownServer:true EnableServer:true EnablePushgateway:false ScrapeEtcd:false ScrapeNodeExporter:false ScrapeWindowsNodeExporter:true ScrapeKubelets:false ScrapeMasterKubelets:false ScrapeKubeProxy:true ScrapeKubeStateMetrics:false ScrapeMetricsServerMetrics:false ScrapeNodeLocalDNS:false ScrapeAnet:false ScrapeCiliumOperator:false APIServerScrapePort:6443 SnapshotProject: ManifestPath:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests CoreManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/*.yaml DefaultServiceMonitors:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/default/*.yaml KubeStateMetricsManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/kube-state-metrics/*.yaml MasterIPServiceMonitors:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/*.yaml MetricsServerManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/metrics-server/*.yaml NodeExporterPod:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/node_exporter/node-exporter.yaml WindowsNodeExporterManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/windows_node_exporter/*.yaml PushgatewayManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/pushgateway/*.yaml StorageClassProvisioner:kubernetes.io/azure-disk StorageClassVolumeType:StandardSSD_LRS ReadyTimeout:15m0s} OverridePaths:[]} I0510 16:34:19.494892 27457 cluster.go:74] Listing cluster nodes: I0510 16:34:19.495054 27457 cluster.go:86] Name: capz-arhn-7xft9, clusterIP: 10.1.0.6, externalIP: , isSchedulable: false I0510 16:34:19.495082 27457 cluster.go:86] Name: capz-arhn-xdbk5, clusterIP: 10.1.0.7, externalIP: , isSchedulable: false I0510 16:34:19.495103 27457 cluster.go:86] Name: capz-arhnvk-control-plane-l8bn6, clusterIP: 10.0.0.4, externalIP: , isSchedulable: true ... skipping 53 lines ... I0510 16:34:25.107396 27457 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/default/prometheus-serviceMonitorLegacyKubeDNS.yaml I0510 16:34:25.141689 27457 prometheus.go:327] Exposing kube-apiserver metrics in the cluster I0510 16:34:25.332295 27457 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-endpoints.yaml I0510 16:34:25.365821 27457 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-service.yaml I0510 16:34:25.399067 27457 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-serviceMonitor.yaml I0510 16:34:25.442855 27457 prometheus.go:406] Waiting for Prometheus stack to become healthy... W0510 16:34:55.471955 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:35:25.472621 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:35:55.472494 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:36:25.472473 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:36:55.472263 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:37:25.473584 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:37:55.472859 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:38:25.473298 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:38:55.471947 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:39:25.473207 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:39:55.480425 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:40:25.472482 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:40:55.472612 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:41:25.473109 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:41:55.472914 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:42:25.473182 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:42:55.472728 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:43:25.472799 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:43:55.472693 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:44:25.473531 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:44:55.473019 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:45:25.473027 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:45:55.472162 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:46:25.473665 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:46:55.473032 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:47:25.473097 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:47:55.472889 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:48:25.473771 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:48:55.473459 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:49:25.472528 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0510 16:49:25.500935 27457 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " I0510 16:49:25.500979 27457 prometheus.go:454] Dumping monitoring/prometheus-k8s events... I0510 16:49:25.530288 27457 prometheus.go:465] { ... skipping 100 lines ... "eventTime": null, "reportingComponent": "", "reportingInstance": "" } ] } F0510 16:49:25.530339 27457 clusterloader.go:300] Error while setting up prometheus stack: timed out waiting for the condition exit status 1 make: Nothing to be done for 'kubectl'. ================ DUMPING LOGS FOR MANAGEMENT CLUSTER ================ Exported logs for cluster "capz" to: /logs/artifacts/management-cluster ================ DUMPING LOGS FOR WORKLOAD CLUSTER (Linux) ========== ... skipping 92 lines ...