kubernetes/perf-tests PR #2065 soak-tests-capz-windows-2019 #1525051655597330432
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | oprinmarius: [WIP] Test |
| Result | Not Finished |
| Started | |
| Revision | |
| Refs |
2065 |
... skipping 672 lines ... certificate.cert-manager.io "selfsigned-cert" deleted # Create secret for AzureClusterIdentity ./hack/create-identity-secret.sh make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' make[2]: Nothing to be done for 'kubectl'. make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Error from server (NotFound): secrets "cluster-identity-secret" not found secret/cluster-identity-secret created secret/cluster-identity-secret labeled # Deploy CAPI curl --retry 3 -sSL https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.1.2/cluster-api-components.yaml | /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/envsubst-v2.0.0-20210730161058-179042472c46 | kubectl apply -f - namespace/capi-system created customresourcedefinition.apiextensions.k8s.io/clusterclasses.cluster.x-k8s.io created ... skipping 132 lines ... # Wait for the kubeconfig to become available. timeout --foreground 300 bash -c "while ! kubectl get secrets | grep capz-jzbrh3-kubeconfig; do sleep 1; done" capz-jzbrh3-kubeconfig cluster.x-k8s.io/secret 1 1s # Get kubeconfig and store it locally. kubectl get secrets capz-jzbrh3-kubeconfig -o json | jq -r .data.value | base64 --decode > ./kubeconfig timeout --foreground 600 bash -c "while ! kubectl --kubeconfig=./kubeconfig get nodes | grep control-plane; do sleep 1; done" error: the server doesn't have a resource type "nodes" capz-jzbrh3-control-plane-c5ktv NotReady <none> 2s v1.23.5 run "kubectl --kubeconfig=./kubeconfig ..." to work with the new target cluster make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Waiting for 1 control plane machine(s), 0 worker machine(s), and 1 windows machine(s) to become Ready node/capz-jzbr-n86lj condition met node/capz-jzbrh3-control-plane-c5ktv condition met ... skipping 76 lines ... go: downloading google.golang.org/grpc v1.36.0 go: downloading sigs.k8s.io/apiserver-network-proxy/konnectivity-client v0.0.22 go: downloading google.golang.org/genproto v0.0.0-20210312152112-fc591d9ea70f I0513 10:09:01.851544 28076 network_performance_measurement.go:87] Registering Network Performance Measurement I0513 10:09:02.022705 28076 clusterloader.go:152] ClusterConfig.Nodes set to 2 I0513 10:09:02.057212 28076 clusterloader.go:158] ClusterConfig.MasterName set to capz-jzbrh3-control-plane-c5ktv E0513 10:09:02.094159 28076 clusterloader.go:169] Getting master external ip error: didn't find any ExternalIP master IPs I0513 10:09:02.131070 28076 clusterloader.go:176] ClusterConfig.MasterInternalIP set to [10.0.0.4] I0513 10:09:02.131144 28076 clusterloader.go:268] Using config: {ClusterConfig:{KubeConfigPath:/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig RunFromCluster:false Nodes:2 Provider:0xc00049db20 EtcdCertificatePath:/etc/srv/kubernetes/pki/etcd-apiserver-server.crt EtcdKeyPath:/etc/srv/kubernetes/pki/etcd-apiserver-server.key EtcdInsecurePort:2382 MasterIPs:[] MasterInternalIPs:[10.0.0.4] MasterName:capz-jzbrh3-control-plane-c5ktv DeleteStaleNamespaces:false DeleteAutomanagedNamespaces:true APIServerPprofByClientEnabled:false KubeletPort:10250 K8SClientsNumber:1 SkipClusterVerification:false} ReportDir:/logs/artifacts EnableExecService:true ModifierConfig:{OverwriteTestConfig:[] SkipSteps:[]} PrometheusConfig:{TearDownServer:true EnableServer:true EnablePushgateway:false ScrapeEtcd:false ScrapeNodeExporter:false ScrapeWindowsNodeExporter:true ScrapeKubelets:false ScrapeMasterKubelets:false ScrapeKubeProxy:true ScrapeKubeStateMetrics:false ScrapeMetricsServerMetrics:false ScrapeNodeLocalDNS:false ScrapeAnet:false ScrapeCiliumOperator:false APIServerScrapePort:6443 SnapshotProject: ManifestPath:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests CoreManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/*.yaml DefaultServiceMonitors:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/default/*.yaml KubeStateMetricsManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/kube-state-metrics/*.yaml MasterIPServiceMonitors:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/*.yaml MetricsServerManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/metrics-server/*.yaml NodeExporterPod:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/node_exporter/node-exporter.yaml WindowsNodeExporterManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/exporters/windows_node_exporter/*.yaml PushgatewayManifests:$GOPATH/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/pushgateway/*.yaml StorageClassProvisioner:kubernetes.io/azure-disk StorageClassVolumeType:StandardSSD_LRS ReadyTimeout:15m0s} OverridePaths:[]} I0513 10:09:02.171948 28076 cluster.go:74] Listing cluster nodes: I0513 10:09:02.171987 28076 cluster.go:86] Name: capz-jzbr-n86lj, clusterIP: 10.1.0.4, externalIP: , isSchedulable: true I0513 10:09:02.172002 28076 cluster.go:86] Name: capz-jzbrh3-control-plane-c5ktv, clusterIP: 10.0.0.4, externalIP: , isSchedulable: true I0513 10:09:02.209052 28076 framework.go:72] Creating framework with 1 clients and "/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig" kubeconfig. ... skipping 50 lines ... I0513 10:09:09.704635 28076 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/default/prometheus-serviceMonitorLegacyKubeDNS.yaml I0513 10:09:09.735936 28076 prometheus.go:327] Exposing kube-apiserver metrics in the cluster I0513 10:09:09.923816 28076 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-endpoints.yaml I0513 10:09:09.957781 28076 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-service.yaml I0513 10:09:09.990629 28076 framework.go:274] Applying /home/prow/go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-serviceMonitor.yaml I0513 10:09:10.027950 28076 prometheus.go:406] Waiting for Prometheus stack to become healthy... W0513 10:09:40.058114 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:10:10.058794 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:10:40.057527 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:11:10.059886 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:11:40.061458 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:12:10.060819 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:12:40.061586 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:13:10.062069 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:13:40.060557 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:14:10.061191 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:14:40.061590 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:15:10.061740 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:15:40.062054 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:16:10.062386 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:16:40.062970 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:17:10.061359 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:17:40.059616 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:18:10.061832 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:18:40.061592 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:19:10.071245 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:19:40.058973 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:20:10.061978 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:20:40.062723 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:21:10.061342 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:21:40.063606 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:22:10.059184 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:22:40.061159 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:23:10.061172 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:23:40.061217 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:24:10.058654 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " W0513 10:24:10.087847 28076 util.go:72] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: k8s v1Status] Failure3no endpoints available for service "prometheus-k8s""ServiceUnavailable0� " I0513 10:24:10.087884 28076 prometheus.go:454] Dumping monitoring/prometheus-k8s events... I0513 10:24:10.117291 28076 prometheus.go:465] { "metadata": { "resourceVersion": "3431" }, "items": null } F0513 10:24:10.117332 28076 clusterloader.go:300] Error while setting up prometheus stack: timed out waiting for the condition make: Nothing to be done for 'kubectl'. ================ DUMPING LOGS FOR MANAGEMENT CLUSTER ================ Exported logs for cluster "capz" to: /logs/artifacts/management-cluster ================ DUMPING LOGS FOR WORKLOAD CLUSTER (Linux) ========== Deploying log-dump-daemonset ... skipping 67 lines ...