Recent runs || View in Spyglass
PR | hccheng72: [V2] fix: prevent requesting replica attachment in a row for one volume |
Result | FAILURE |
Tests | 22 failed / 6 succeeded |
Started | |
Elapsed | 3h12m |
Revision | 4a6e564a41c033131fafa6cc72ac48890563d7c5 |
Refs |
1693 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[AfterSuite\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:121 ------------------------------ This is the Progress Report generated when the timeout occurred: In [AfterSuite] (Node Runtime: 30.001s) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:121 Spec Goroutine goroutine 7276 [chan send, 2 minutes] github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2.1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/internal/suite.go:746 panic({0x203b9a0, 0xc0007ffa40}) /usr/local/go/src/runtime/panic.go:884 github.com/onsi/ginkgo/v2.Fail({0xc0007c00f0, 0x50}, {0xc000a4fc38?, 0x21d0129?, 0xc000a4fc58?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/core_dsl.go:352 k8s.io/kubernetes/test/e2e/framework.Fail({0xc000064800, 0x3b}, {0xc000a4fcd0?, 0xc000064800?, 0xc000a4fcf8?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/log.go:61 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x26c38c0, 0xc000412a00}, {0x0?, 0x0?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:76 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:43 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Cleanup(0xc000a9d2c0, 0xd18c2e2800) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:215 panic({0x203b9a0, 0xc0007ff340}) /usr/local/go/src/runtime/panic.go:884 github.com/onsi/ginkgo/v2.Fail({0xc0007c0050, 0x50}, {0xc000a50400?, 0x21d0129?, 0xc000a50420?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/core_dsl.go:352 k8s.io/kubernetes/test/e2e/framework.Fail({0xc0003bee00, 0x3b}, {0xc000a50498?, 0xc0003bee00?, 0xc000a504c0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/log.go:61 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x26c38c0, 0xc00104df40}, {0x0?, 0x0?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:76 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:43 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000a9d2c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 > sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedResizeVolumeTest).Run(0xc000af1c68, {0x26fb380?, 0xc000a0fa00}, 0xc00078cdc0, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_resize_volume_tester.go:61 | | ginkgo.By("deploying the statefulset") > tStatefulSet.Create() | | ginkgo.By("checking that the pod for statefulset is running") > sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func20() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:843 | test.StorageClassParameters = map[string]string{consts.SkuNameField: "StandardSSD_ZRS", "fsType": "btrfs"} | } > test.Run(cs, ns, schedulerName) | }) | github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc0006f8480, 0xc00021ea80}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/internal/node.go:449 github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 github.com/onsi/ginkgo/v2/internal.(*Suite).runNode /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 7373 [syscall, 2 minutes] syscall.Syscall6(0x4?, 0x4?, 0x0?, 0x0?, 0xffffffffffffff9c?, 0x0?, 0xc0006e56f8?) /usr/local/go/src/syscall/syscall_linux.go:90 os.(*Process).blockUntilWaitable(0xc000e30e40) /usr/local/go/src/os/wait_waitid.go:32 os.(*Process).wait(0xc000e30e40) /usr/local/go/src/os/exec_unix.go:22 os.(*Process).Wait(...) /usr/local/go/src/os/exec.go:132 os/exec.(*Cmd).Wait(0xc000b1e420) /usr/local/go/src/os/exec/exec.go:599 os/exec.(*Cmd).Run(0x21d1162?) /usr/local/go/src/os/exec/exec.go:437 sigs.k8s.io/azuredisk-csi-driver/test/utils/testutil.ExecTestCmd({0xc0009c9e48, 0x1, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/utils/testutil/test_ops_util.go:74 > sigs.k8s.io/azuredisk-csi-driver/test/e2e.glob..func6() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:160 | EndLog: "example deployments created", | } > testutil.ExecTestCmd([]testutil.TestCmd{createExampleDeployment}) | | azurediskLogArgs := []string{"test/utils/azuredisk_log.sh", "azuredisk"} github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0x9b8fce, 0xc000522000}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/internal/node.go:449 github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 github.com/onsi/ginkgo/v2/internal.(*Suite).runNode /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 ------------------------------from junit_01.xml
I0117 21:47:02.936973 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:47:04.937544 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready Jan 17 21:47:06.937: INFO: Unexpected error: <*errors.StatusError | 0xc00104df40>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "statefulsets.apps \"azuredisk-volume-tester-bn9vh\" not found", Reason: "NotFound", Details: { Name: "azuredisk-volume-tester-bn9vh", Group: "apps", Kind: "statefulsets", UID: "", Causes: nil, RetryAfterSeconds: 0, }, Code: 404, }, } Jan 17 21:47:06.937: FAIL: statefulsets.apps "azuredisk-volume-tester-bn9vh" not found Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000a9d2c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 +0x12e sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedResizeVolumeTest).Run(0xc000a51c68, {0x26fb380?, 0xc000a0fa00}, 0xc00078cdc0, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_resize_volume_tester.go:61 +0x265 sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func20() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:843 +0x7f0 Jan 17 21:47:06.937: INFO: deleting StatefulSet "azuredisk-9587"/"azuredisk-volume-tester-bn9vh" Jan 17 21:47:06.975: INFO: Unexpected error: <*errors.StatusError | 0xc000412a00>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "statefulsets.apps \"azuredisk-volume-tester-bn9vh\" not found", Reason: "NotFound", Details: { Name: "azuredisk-volume-tester-bn9vh", Group: "apps", Kind: "statefulsets", UID: "", Causes: nil, RetryAfterSeconds: 0, }, Code: 404, }, } Jan 17 21:47:06.975: FAIL: statefulsets.apps "azuredisk-volume-tester-bn9vh" not found Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Cleanup(0xc000a9d2c0, 0xd18c2e2800) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:215 +0x186 panic({0x203b9a0, 0xc0007ff340}) /usr/local/go/src/runtime/panic.go:884 +0x212 k8s.io/kubernetes/test/e2e/framework.Fail({0xc0003bee00, 0x3b}, {0xc000a50498?, 0xc0003bee00?, 0xc000a504c0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/log.go:61 +0x145 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x26c38c0, 0xc00104df40}, {0x0?, 0x0?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:76 +0x267 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:43 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000a9d2c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 +0x12e sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedResizeVolumeTest).Run(0xc000a51c68, {0x26fb380?, 0xc000a0fa00}, 0xc00078cdc0, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_resize_volume_tester.go:61 +0x265 sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func20() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:843 +0x7f0 Jan 17 21:47:06.976: INFO: deleting StorageClass azuredisk-9587-disk.csi.azure.com-dynamic-sc-hxxdk
Find for mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sAzDiskSchedulerExtender\s\[single\-az\]\sShould\sschedule\sand\sreschedule\sa\spod\swith\sa\spersistent\svolume\srequest\son\sfailover\.\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000eb4b90) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 +0x12e sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailover).Run(0xc000babb70, {0x26fb380, 0xc0005ce9c0}, 0x7?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover.go:55 +0x2c5 sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func4() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:151 +0x5ee There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e25a0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc000784490?, 0xc000c1bf08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc000b8c1b0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc000784490?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T19:13:31.325677385Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T19:13:31.327046658Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T19:13:31.442829354Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T19:13:31.516395651Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:258 2023-01-17T19:13:31.589826968Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T19:13:31.678766042Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T19:13:31.718104263Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:303 2023-01-17T19:13:31.718260204Z &{Text:setting up the statefulset Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover.go:54 2023-01-17T19:13:31.756917673Z &{Text:deploying the statefulset Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T19:23:32.03262543Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T19:23:32.033077342Z &{Text:Destroying namespace "azuredisk-3212" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 19:13:31.325�[0m Jan 17 19:13:31.325: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 19:13:31.327�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 19:13:31.442�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 19:13:31.516�[0m I0117 19:13:31.589700 16300 azuredisk_driver.go:52] Using azure disk driver: disk.csi.azure.com �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 19:13:31.589�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 19:13:31.678�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 19:13:31.718�[0m �[1mSTEP:�[0m setting up the statefulset �[38;5;243m01/17/23 19:13:31.718�[0m �[1mSTEP:�[0m deploying the statefulset �[38;5;243m01/17/23 19:13:31.756�[0m I0117 19:13:31.836958 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:33.876198 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:35.875538 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:37.876924 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:39.878868 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:41.878700 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:43.876237 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:45.875917 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:47.878724 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:49.876017 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:51.880535 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:53.882006 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:55.884091 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:57.879531 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:13:59.876364 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:01.879289 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:03.876747 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:05.879151 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:07.883228 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:09.877222 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:11.876209 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:13.878909 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:15.879355 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:17.880176 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:19.881286 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:21.878154 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:23.876954 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:25.878771 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:27.879658 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:29.875478 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:31.876306 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:33.876034 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:35.880467 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:37.879862 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:39.876298 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:41.876213 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:43.876990 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:45.881030 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:47.888330 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:49.876219 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:51.879225 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:53.876004 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:55.876185 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:57.877497 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:14:59.876019 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:01.882138 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:03.882545 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:05.877383 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:07.875933 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:09.878723 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:11.877018 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:13.876329 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:15.876855 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:17.876244 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:19.876442 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:21.875699 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:23.876507 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:25.881750 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:27.877448 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:29.881164 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:31.876038 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:33.875898 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:35.876055 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:37.874420 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:39.875816 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:41.874756 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:43.875531 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:45.876321 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:47.875104 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:49.881526 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:51.877128 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:53.873910 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:55.874528 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:57.875845 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:15:59.875037 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:01.875817 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:03.878998 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:05.875203 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:07.876979 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:09.878068 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:11.875801 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:13.891249 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:15.875035 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:17.876739 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:19.876217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:21.875306 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:23.874738 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:25.875730 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:27.874498 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:29.878291 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:31.875300 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:33.874839 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:35.878193 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:37.875238 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:39.875626 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:41.881412 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:43.874735 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:45.879697 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:47.875705 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:49.876825 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:51.875225 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:53.874984 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:55.874302 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:57.877772 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:16:59.876425 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:01.876234 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:03.876178 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:05.879957 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:07.875961 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:09.882006 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:11.882870 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:13.874710 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:15.877302 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:17.875553 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:19.875075 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:21.875076 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:23.874322 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:25.873915 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:27.883815 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:29.874878 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:31.874711 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:33.881420 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:35.875056 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:37.874334 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:39.876930 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:41.877519 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:43.876160 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:45.874903 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:47.875683 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:49.877551 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:51.874386 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:53.876112 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:55.878773 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:57.874161 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:17:59.875046 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:01.874735 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:03.875118 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:05.876231 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:07.874823 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:09.876161 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:11.875298 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:13.874839 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:15.879358 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:17.875295 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:19.875866 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:22.059247 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:23.876940 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:25.876798 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:27.880897 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:29.875798 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:31.889046 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:33.876191 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:35.878190 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:37.877171 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:39.883932 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:41.879287 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:43.879038 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:45.876180 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:47.878130 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:49.877467 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:51.881346 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:53.878223 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:55.877366 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:57.878659 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:18:59.882315 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:01.876229 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:03.884217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:05.876442 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:07.875942 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:09.883164 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:11.876319 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:13.875684 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:15.876730 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:17.882556 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:19.877151 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:21.877086 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:23.876480 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:25.878350 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:27.876477 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:29.875824 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:31.882165 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:33.877255 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:35.876312 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:37.883692 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:39.876112 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:41.884968 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:43.875490 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:45.875762 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:47.884648 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:49.878244 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:51.889565 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:53.881212 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:55.878447 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:57.877782 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:19:59.881093 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:01.877090 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:03.880184 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:05.883938 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:07.877535 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:09.875778 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:11.885295 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:13.876775 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:15.888608 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:17.877437 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:19.885276 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:21.877616 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:23.876551 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:25.881278 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:27.877255 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:29.878011 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:31.877354 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:33.878828 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:35.882674 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:37.877924 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:39.877084 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:41.878724 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:43.878705 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:45.881207 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:47.878067 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:49.885705 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:51.877280 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:53.879822 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:55.883906 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:57.880097 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:20:59.877122 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:01.881902 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:03.877190 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:05.880639 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:07.877955 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:09.877816 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:11.876014 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:13.886611 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:15.876281 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:17.878028 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:19.879198 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:21.876783 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:23.879968 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:25.879453 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:27.879418 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:29.876586 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:31.878636 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:33.877482 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:35.877039 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:37.877198 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:39.876291 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:41.877636 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:43.882480 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:45.877654 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:47.877182 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:49.881831 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:51.876097 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:53.876173 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:55.877737 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:57.875170 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:21:59.887320 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:01.877503 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:03.876008 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:05.876308 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:07.877800 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:09.875434 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:11.876142 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:13.886529 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:15.880159 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:17.885028 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:19.875276 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:21.877093 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:23.875633 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:25.879411 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:27.876042 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:29.882157 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:31.877776 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:33.881084 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:35.877800 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:37.875654 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:39.875557 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:41.877092 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:43.876607 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:45.880799 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:47.879549 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:49.877931 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:51.879144 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:53.881411 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:55.877599 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:57.877667 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:22:59.878555 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:01.878035 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:03.876140 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:05.878083 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:07.875190 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:09.878241 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:11.898772 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:13.875986 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:15.887722 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:17.883416 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:19.875729 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:21.875558 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:23.877141 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:25.878884 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:27.881060 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:29.875770 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:31.876818 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:23:31.914854 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready Jan 17 19:23:31.914: INFO: Unexpected error: <*errors.errorString | 0xc000406fb0>: { s: "timed out waiting for the condition", } Jan 17 19:23:31.915: FAIL: timed out waiting for the condition Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000eb4b90) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 +0x12e sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailover).Run(0xc000babb70, {0x26fb380, 0xc0005ce9c0}, 0x7?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover.go:55 +0x2c5 sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func4() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:151 +0x5ee Jan 17 19:23:31.915: INFO: deleting StatefulSet "azuredisk-3212"/"azuredisk-volume-tester-pg98p" Jan 17 19:23:31.992: INFO: Unexpected error: <*errors.errorString | 0xc000d51ab0>: { s: "resource name may not be empty", } Jan 17 19:23:31.992: FAIL: resource name may not be empty Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Cleanup(0xc000eb4b90, 0xd18c2e2800) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:225 +0x4d6 panic({0x203b9a0, 0xc00026f6c0}) /usr/local/go/src/runtime/panic.go:884 +0x212 k8s.io/kubernetes/test/e2e/framework.Fail({0x2218fdb, 0x23}, {0xc000baabc0?, 0x2218fdb?, 0xc000baabe8?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/log.go:61 +0x145 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x26bff40, 0xc000406fb0}, {0x0?, 0x0?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:76 +0x267 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:43 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000eb4b90) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 +0x12e sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailover).Run(0xc000babb70, {0x26fb380, 0xc0005ce9c0}, 0x7?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover.go:55 +0x2c5 sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func4() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:151 +0x5ee Jan 17 19:23:31.993: INFO: deleting StorageClass azuredisk-3212-disk.csi.azure.com-dynamic-sc-5c8rf �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 19:23:32.032�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-3212" for this suite. �[38;5;243m01/17/23 19:23:32.033�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sAzDiskSchedulerExtender\s\[single\-az\]\sShould\sschedule\sand\sstart\sa\spod\swith\sa\spersistent\svolume\srequests\.\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000ba7890, {0x26fb380?, 0xc000c92000}, 0xc000b934a0, {0x7ff9f557a358, 0xc0000a7f50}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingWithPVTest).Run(0xc000ba7c78, {0x26fb380, 0xc000c92000}, 0x7?, {0x220ec17?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_with_pv_tester.go:39 +0x108 sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func3() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:114 +0x48e There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e25a0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc0001b3500?, 0xc00009ff08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc000eed230?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc0001b3500?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T19:08:28.998665719Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T19:08:29.000993378Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T19:08:29.11539072Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T19:08:29.190392967Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T19:08:29.26427928Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T19:08:29.264813295Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T19:08:29.304079411Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T19:08:29.304275782Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T19:08:29.345414276Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T19:13:31.284972967Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T19:13:31.28526162Z &{Text:Destroying namespace "azuredisk-1972" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 19:08:28.998�[0m Jan 17 19:08:28.998: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 19:08:29�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 19:08:29.115�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 19:08:29.19�[0m I0117 19:08:29.264142 16300 azuredisk_driver.go:52] Using azure disk driver: disk.csi.azure.com �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 19:08:29.264�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 19:08:29.264�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 19:08:29.304�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 19:08:29.304�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 19:08:29.345�[0m Jan 17 19:08:29.345: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-9hwv5] to have phase Bound Jan 17 19:08:29.383: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:31.422: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:33.463: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:35.502: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:37.541: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:39.579: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:41.620: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:43.659: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:45.698: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:47.738: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:49.776: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:51.816: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:53.856: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:55.896: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:57.943: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:08:59.985: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:02.024: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:04.064: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:06.103: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:08.143: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:10.184: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:12.223: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:14.262: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:16.302: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:18.340: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:20.380: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:22.418: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:24.459: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:26.499: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:28.538: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:30.577: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:32.617: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:34.656: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:36.696: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:38.736: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:40.775: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:42.814: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:44.856: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:46.894: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:48.935: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:50.974: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:53.013: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:55.053: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:57.093: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:09:59.132: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:01.172: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:03.211: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:05.251: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:07.290: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:09.331: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:11.371: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:13.413: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:15.453: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:17.493: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:19.533: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:21.580: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:23.619: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:25.659: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:27.700: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:29.739: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:31.780: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:33.819: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:35.859: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:37.899: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:39.940: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:41.980: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:44.021: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:46.062: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:48.103: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:50.143: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:52.183: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:54.223: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:56.264: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:10:58.305: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:00.345: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:02.385: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:04.425: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:06.465: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:08.505: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:10.545: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:12.585: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:14.627: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:16.666: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:18.706: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:20.746: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:22.785: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:24.826: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:26.867: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:28.908: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:30.949: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:32.989: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:35.036: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:37.076: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:39.117: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:41.158: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:43.198: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:45.239: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:47.278: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:49.319: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:51.360: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:53.401: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:55.442: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:57.483: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:11:59.523: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:01.563: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:03.604: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:05.643: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:07.683: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:09.723: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:11.762: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:13.801: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:15.841: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:17.880: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:19.918: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:21.959: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:23.999: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:26.037: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:28.076: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:30.115: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:32.165: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:34.211: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:36.250: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:38.288: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:40.327: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:42.366: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:44.406: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:46.445: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:48.483: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:50.523: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:52.562: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:54.602: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:56.640: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:12:58.680: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:00.718: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:02.758: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:04.797: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:06.836: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:08.886: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:10.924: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:12.964: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:15.003: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:17.043: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:19.081: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:21.121: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:23.163: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:25.201: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:27.243: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:29.283: INFO: PersistentVolumeClaim pvc-9hwv5 found but phase is Pending instead of Bound. Jan 17 19:13:31.283: INFO: Unexpected error: <*errors.errorString | 0xc0004d5c60>: { s: "PersistentVolumeClaims [pvc-9hwv5] not all in phase Bound within 5m0s", } Jan 17 19:13:31.284: FAIL: PersistentVolumeClaims [pvc-9hwv5] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000ba7890, {0x26fb380?, 0xc000c92000}, 0xc000b934a0, {0x7ff9f557a358, 0xc0000a7f50}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingWithPVTest).Run(0xc000ba7c78, {0x26fb380, 0xc000c92000}, 0x7?, {0x220ec17?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_with_pv_tester.go:39 +0x108 sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func3() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:114 +0x48e �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 19:13:31.284�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-1972" for this suite. �[38;5;243m01/17/23 19:13:31.285�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sAzDiskSchedulerExtender\s\[single\-az\]\sShould\sschedule\sand\sstart\sa\spod\swith\smultiple\spersistent\svolume\srequests\sand\sreschedule\son\sfailover\.$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000eb5720) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 +0x12e sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run.func1(0xc000eb5720) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:66 +0x8f created by sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:62 +0x20d There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e25a0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc0001b3320?, 0xc000f5af08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc000e7f0b0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc0001b3320?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T19:28:34.41904745Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T19:28:34.421509884Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T19:28:34.538265564Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T19:28:34.612656233Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:258 2023-01-17T19:28:34.687459267Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T19:28:34.761425103Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T19:28:34.800095246Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T19:28:34.800250296Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T19:28:34.800332131Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:303 2023-01-17T19:28:34.800463563Z &{Text:setting up the statefulset Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T19:28:34.800752132Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T19:28:34.800868341Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T19:28:34.800995504Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:303 2023-01-17T19:28:34.801105667Z &{Text:setting up the statefulset Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T19:49:45.442215766Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T19:49:45.442758443Z &{Text:Destroying namespace "azuredisk-7525" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 19:28:34.419�[0m Jan 17 19:28:34.419: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 19:28:34.421�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 19:28:34.538�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 19:28:34.612�[0m I0117 19:28:34.687158 16300 azuredisk_driver.go:52] Using azure disk driver: disk.csi.azure.com �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 19:28:34.687�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 19:28:34.761�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 19:28:34.8�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 19:28:34.8�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 19:28:34.8�[0m �[1mSTEP:�[0m setting up the statefulset �[38;5;243m01/17/23 19:28:34.8�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 19:28:34.8�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 19:28:34.8�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 19:28:34.8�[0m �[1mSTEP:�[0m setting up the statefulset �[38;5;243m01/17/23 19:28:34.801�[0m I0117 19:28:34.891082 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:34.891530 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:36.930782 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:36.931032 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:38.930403 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:38.931630 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:40.931771 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:40.932028 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:42.932059 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:42.932075 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:44.932509 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:44.932517 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:46.931345 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:46.931803 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:48.930078 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:48.930270 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:50.929491 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:50.929493 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:52.930734 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:52.930735 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:54.930807 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:54.930857 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:56.932412 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:56.933066 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:58.931553 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:28:58.931580 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:00.931483 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:00.931562 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:02.933196 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:02.933622 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:04.932349 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:04.932444 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:06.932017 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:06.932274 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:08.932180 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:08.932241 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:10.930989 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:10.931737 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:12.931004 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:12.931014 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:14.931797 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:14.931876 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:16.929813 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:16.931579 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:18.930459 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:18.930534 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:20.933552 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:20.934069 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:22.931500 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:22.931569 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:24.933307 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:24.938130 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:26.933579 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:26.933630 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:28.934079 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:28.934138 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:30.932007 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:30.932006 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:32.931958 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:32.932382 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:34.931446 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:34.931600 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:36.931689 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:36.931691 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:38.933167 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:38.943942 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:40.930037 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:40.930157 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:42.931823 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:42.931825 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:44.931534 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:44.932383 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:46.931204 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:46.931841 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:48.931784 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:48.932109 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:50.934790 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:50.934983 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:52.932313 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:52.932519 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:54.931144 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:54.931272 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:56.943274 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:56.943433 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:58.932690 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:29:58.932726 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:00.937482 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:00.937731 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:02.932611 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:02.932800 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:04.930841 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:04.931592 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:06.932755 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:06.934132 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:08.931256 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:08.932705 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:10.931540 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:10.932315 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:12.934587 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:12.934589 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:14.930525 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:14.931164 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:16.932060 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:16.932174 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:18.933246 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:18.933248 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:20.932067 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:20.932187 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:22.931017 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:22.932022 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:24.931380 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:24.932306 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:26.931512 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:26.931651 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:28.932291 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:28.933459 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:30.931548 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:30.932006 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:32.931722 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:32.932236 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:34.930360 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:34.930945 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:36.935609 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:36.936174 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:38.930495 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:38.930905 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:40.932462 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:40.932821 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:42.931936 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:42.932640 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:44.932341 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:44.932339 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:46.937258 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:46.937277 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:48.932867 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:48.933821 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:50.931569 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:50.932056 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:52.930295 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:52.930297 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:54.931881 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:54.932288 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:56.930077 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:56.930169 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:58.932626 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:30:58.932626 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:00.931076 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:00.931227 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:02.931597 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:02.931795 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:04.931215 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:04.931303 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:06.934810 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:06.934859 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:08.930401 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:08.930571 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:10.929857 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:10.930096 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:12.931073 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:12.931309 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:14.931664 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:14.931666 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:16.932075 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:16.932499 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:18.930756 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:18.930928 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:20.935731 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:20.935829 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:22.933454 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:22.933775 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:24.930747 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:24.931031 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:26.930964 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:26.931053 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:28.931200 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:28.931296 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:30.932527 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:30.932705 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:32.931579 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:32.935211 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:34.931087 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:34.931247 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:36.932563 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:36.947083 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:38.931314 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:38.931426 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:40.931261 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:40.931301 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:42.940314 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:42.941506 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:44.940152 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:44.940892 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:46.934041 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:46.934165 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:48.933541 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:48.934107 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:50.931388 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:50.931834 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:52.937577 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:52.938318 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:54.930296 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:54.930939 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:56.932295 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:56.932521 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:58.931677 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:31:58.931886 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:00.929318 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:00.929978 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:02.931032 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:02.931160 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:04.938282 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:04.939403 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:06.944257 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:06.945552 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:08.931752 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:08.934126 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:10.930652 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:10.935782 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:12.930885 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:12.932901 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:14.932046 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:14.936846 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:16.930166 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:16.930274 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:18.933802 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:18.935683 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:20.936303 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:20.937082 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:22.933209 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:22.945008 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:24.931891 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:24.933944 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:26.932834 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:26.933479 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:28.932888 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:28.933256 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:30.936032 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:30.936993 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:32.935154 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:32.935827 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:34.934317 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:34.934635 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:36.932448 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:36.933850 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:38.934623 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:38.935575 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:40.931279 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:40.932386 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:42.936277 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:42.937802 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:44.931318 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:44.932141 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:46.931436 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:46.933977 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:48.932116 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:48.933142 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:50.934680 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:50.936027 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:52.933377 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:52.933385 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:54.933528 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:54.933903 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:56.934762 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:56.935038 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:58.932906 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:32:58.932907 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:00.932025 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:00.932021 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:02.933099 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:02.933105 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:04.930735 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:04.930834 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:06.934878 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:06.936254 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:08.933722 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:08.937164 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:10.933382 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:10.933703 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:12.970630 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:12.971764 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:14.933822 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:14.933946 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:16.944631 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:16.944896 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:18.932798 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:18.933079 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:20.933795 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:20.934144 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:22.931029 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:22.931424 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:24.931411 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:24.931711 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:26.929975 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:26.929988 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:28.935008 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:28.935311 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:30.932725 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:30.933894 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:32.933710 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:32.934563 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:34.932406 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:34.933603 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:36.931354 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:36.931674 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:38.937391 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:38.937598 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:40.931959 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:40.932160 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:42.931691 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:42.932203 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:44.930268 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:44.931099 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:46.933253 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:46.934865 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:48.931346 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:48.931748 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:50.931704 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:50.932610 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:52.932563 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:52.933624 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:54.930788 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:54.930927 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:56.931994 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:56.932044 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:58.932980 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:33:58.933310 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:00.936732 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:00.937175 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:02.941047 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:02.941051 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:04.932660 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:04.933197 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:06.934103 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:06.934294 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:08.943747 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:08.943957 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:10.934647 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:10.935086 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:12.930184 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:12.930698 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:14.931638 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:14.932257 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:16.939982 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:16.940544 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:18.931622 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:18.932068 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:20.930955 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:20.933298 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:22.929981 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:22.930752 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:24.933421 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:24.934271 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:26.930538 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:26.930885 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:28.932214 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:28.936955 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:30.931823 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:30.933419 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:32.931136 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:32.931314 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:34.931305 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:34.931722 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:36.931437 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:36.932118 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:38.933044 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:38.933529 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:40.932162 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:40.934259 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:42.931267 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:42.931983 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:44.933561 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:44.933824 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:46.931095 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:46.931124 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:48.932231 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:48.934315 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:50.932075 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:50.932103 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:52.932189 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:52.932488 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:54.931251 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:54.931364 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:56.931913 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:56.932010 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:58.933256 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:34:58.933886 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:00.931749 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:00.931842 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:02.929728 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:02.929785 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:04.931328 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:04.931327 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:06.931659 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:06.931661 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:08.931180 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:08.932414 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:10.931385 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:10.931555 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:12.929743 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:12.937159 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:14.931646 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:14.931649 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:16.930193 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:16.930200 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:18.938893 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:18.939145 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:20.931315 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:20.931557 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:22.930770 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:22.931182 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:24.931571 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:24.931610 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:26.930906 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:26.930930 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:28.932203 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:28.937167 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:30.937262 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:30.937504 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:32.931115 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:32.931314 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:34.931627 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:34.932010 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:36.931205 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:36.931317 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:38.933394 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:38.933537 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:40.930441 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:40.930846 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:42.932955 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:42.932984 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:44.931038 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:44.931036 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:46.931260 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:46.932531 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:48.932016 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:48.932063 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:50.931542 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:50.931541 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:52.932749 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:52.932908 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:54.931566 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:54.931709 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:56.930466 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:56.930772 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:58.931739 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:35:58.932195 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:00.930473 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:00.930938 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:02.933261 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:02.933679 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:04.931477 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:04.931902 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:06.930492 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:06.930507 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:08.930494 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:08.930526 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:10.929440 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:10.929749 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:12.939755 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:12.939869 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:14.931568 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:14.931897 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:16.931406 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:16.931560 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:18.931007 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:18.931317 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:20.933257 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:20.933363 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:22.931051 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:22.931339 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:24.931316 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:24.932216 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:26.934152 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:26.934221 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:28.930942 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:28.931159 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:30.933514 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:30.934092 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:32.939467 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:32.939908 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:34.931122 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:34.931121 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:36.931360 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:36.931360 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:38.931394 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:38.931576 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:40.931064 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:40.931437 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:42.930813 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:42.931151 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:44.930850 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:44.931147 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:46.934966 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:46.935378 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:48.935076 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:48.936789 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:50.931171 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:50.931987 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:52.931178 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:52.931254 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:54.929703 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:54.929818 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:56.931094 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:56.931148 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:58.931846 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:36:58.931982 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:00.930773 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:00.930786 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:02.931991 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:02.932152 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:04.931162 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:04.931397 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:06.930144 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:06.930302 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:08.936425 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:08.936965 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:10.947226 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:10.947453 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:12.931063 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:12.931437 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:14.932401 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:14.932522 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:16.929710 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:16.929992 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:18.931779 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:18.932023 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:20.932298 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:20.932426 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:22.933375 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:22.933696 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:24.931601 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:24.931749 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:26.930985 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:26.931441 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:28.930102 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:28.930215 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:30.931543 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:30.931662 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:32.932499 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:32.932631 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:34.930601 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:34.930706 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:36.931401 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:36.931443 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:38.930583 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:38.930581 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:40.937243 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:40.937378 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:42.929980 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:42.931025 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:44.930003 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:44.930646 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:46.932145 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:46.932740 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:48.931153 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:48.933062 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:50.931125 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:50.931145 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:52.931413 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:52.931423 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:54.933217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:54.933239 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:56.930858 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:56.932769 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:58.929910 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:37:58.929904 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:00.931289 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:00.931635 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:02.930604 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:02.930707 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:04.929884 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:04.931517 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:06.931201 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:06.931241 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:08.931174 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:08.931727 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:10.936642 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:10.936835 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:12.948891 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:12.948916 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:14.931262 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:14.931440 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:16.931887 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:16.931945 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:18.931065 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:18.931255 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:20.930386 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:20.930925 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:22.931142 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:22.931217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:24.932041 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:24.932306 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:26.931441 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:26.931681 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:28.931127 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:28.931236 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:30.938935 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:30.938945 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:32.937691 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:32.940161 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:34.931346 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:34.931366 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:38:34.969120 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready Jan 17 19:38:34.969: INFO: Unexpected error: <*errors.errorString | 0xc000406fb0>: { s: "timed out waiting for the condition", } I0117 19:38:34.969603 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready Jan 17 19:38:34.969: INFO: Unexpected error: <*errors.errorString | 0xc000406fb0>: { s: "timed out waiting for the condition", } Jan 17 19:38:34.970: FAIL: timed out waiting for the condition Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000eb5450) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 +0x12e sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run.func1(0xc000eb5450) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:66 +0x8f created by sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:62 +0x20d Jan 17 19:38:34.970: FAIL: timed out waiting for the condition Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000eb5720) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 +0x12e sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run.func1(0xc000eb5720) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:66 +0x8f created by sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:62 +0x20d Jan 17 19:38:45.018: INFO: Deleting all pods with map[group:delete-for-failover] labels in namespace azuredisk-7525 I0117 19:39:45.157243 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:45.157446 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:47.197770 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:47.197962 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:49.196534 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:49.196894 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:51.204233 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:51.204350 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:53.198308 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:53.198309 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:55.196783 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:55.196980 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:57.197957 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:57.199883 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:59.198838 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:39:59.199501 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:01.196839 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:01.196869 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:03.197445 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:03.197464 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:05.195925 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:05.196359 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:07.196334 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:07.196435 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:09.197595 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:09.197593 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:11.195631 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:11.195701 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:13.196375 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:13.196568 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:15.196896 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:15.196940 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:17.197105 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:17.197683 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:19.195855 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:19.196301 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:21.197416 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:21.197480 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:23.197339 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:23.197881 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:25.198251 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:25.198385 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:27.196115 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:27.196564 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:29.198659 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:29.199474 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:31.196556 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:31.196639 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:33.195535 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:33.195620 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:35.196388 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:35.196492 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:37.197094 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:37.197259 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:39.198022 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:39.198058 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:41.197324 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:41.197525 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:43.197407 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:43.197405 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:45.196998 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:45.197027 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:47.195905 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:47.195936 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:49.198055 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:49.198129 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:51.197402 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:51.197726 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:53.199268 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:53.199267 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:55.197607 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:55.197714 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:57.198648 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:57.198723 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:59.198121 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:40:59.198129 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:01.197688 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:01.197855 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:03.200229 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:03.202305 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:05.198289 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:05.198291 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:07.197065 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:07.197134 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:09.197954 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:09.197963 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:11.196683 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:11.196708 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:13.197675 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:13.197801 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:15.196801 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:15.196807 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:17.197642 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:17.197807 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:19.196260 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:19.196353 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:21.197957 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:21.198006 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:23.197457 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:23.197601 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:25.200276 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:25.200377 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:27.200161 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:27.200184 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:29.197818 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:29.198717 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:31.196238 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:31.196237 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:33.196536 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:33.196878 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:35.196752 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:35.196909 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:37.198891 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:37.198987 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:39.198331 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:39.198435 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:41.198162 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:41.198306 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:43.198093 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:43.198099 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:45.198855 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:45.198893 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:47.198071 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:47.198186 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:49.196330 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:49.196799 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:51.199609 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:51.199617 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:53.198058 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:53.198528 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:55.196419 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:55.196463 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:57.197495 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:57.197496 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:59.197837 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:41:59.197989 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:01.198027 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:01.198029 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:03.198280 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:03.198893 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:05.197280 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:05.198021 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:07.198381 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:07.198464 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:09.202459 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:09.202609 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:11.197551 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:11.197983 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:13.197901 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:13.198403 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:15.196252 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:15.196299 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:17.196108 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:17.196120 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:19.197897 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:19.197916 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:21.199953 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:21.200011 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:23.199425 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:23.199511 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:25.197354 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:25.197519 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:27.197560 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:27.198154 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:29.198401 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:29.198543 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:31.196836 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:31.196864 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:33.199263 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:33.199578 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:35.196141 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:35.196284 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:37.197451 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:37.197969 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:39.198181 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:39.198183 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:41.200642 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:41.200649 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:43.195774 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:43.196077 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:45.195420 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:45.195420 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:47.197354 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:47.197354 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:49.196396 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:49.196547 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:51.197250 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:51.199206 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:53.198098 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:53.198189 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:55.198778 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:55.198957 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:57.199822 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:57.199910 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:59.195516 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:42:59.195935 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:01.200129 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:01.201354 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:03.197399 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:03.197472 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:05.199661 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:05.199777 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:07.197198 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:07.197374 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:09.198009 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:09.198895 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:11.197494 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:11.197632 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:13.197515 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:13.197513 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:15.196452 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:15.196456 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:17.198394 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:17.198487 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:19.195910 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:19.195983 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:21.195861 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:21.196222 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:23.197550 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:23.197695 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:25.197006 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:25.197217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:27.197624 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:27.197801 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:29.198774 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:29.199083 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:31.197857 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:31.197859 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:33.196602 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:33.196743 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:35.197353 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:35.198339 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:37.197793 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:37.200219 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:39.198497 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:39.198543 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:41.197180 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:41.197308 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:43.196524 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:43.196604 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:45.201538 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:45.201552 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:47.196712 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:47.196845 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:49.199072 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:49.199369 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:51.197707 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:51.197749 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:53.195635 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:53.195781 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:55.196973 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:55.197348 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:57.197863 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:57.197981 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:59.197501 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:43:59.197641 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:01.197174 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:01.197403 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:03.197207 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:03.197277 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:05.201552 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:05.201554 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:07.197954 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:07.198041 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:09.196336 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:09.196360 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:11.198379 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:11.198485 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:13.197672 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:13.197671 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:15.197553 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:15.197604 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:17.196636 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:17.196637 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:19.196378 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:19.196647 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:21.197165 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:21.197217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:23.197989 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:23.198059 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:25.198801 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:25.198986 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:27.196698 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:27.196815 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:29.197479 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:29.197746 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:31.196884 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:31.196933 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:33.197600 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:33.197739 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:35.195930 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:35.196123 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:37.198644 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:37.199018 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:39.199344 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:39.199769 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:41.196762 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:41.197676 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:43.197360 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:43.197372 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:45.196012 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:45.196086 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:47.199758 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:47.199844 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:49.197931 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:49.198069 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:51.197010 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:51.197078 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:53.198372 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:53.198512 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:55.197200 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:55.197288 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:57.197087 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:57.199580 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:59.199034 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:44:59.201254 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:01.197297 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:01.198037 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:03.197421 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:03.197525 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:05.197068 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:05.197308 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:07.198447 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:07.198601 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:09.196515 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:09.196838 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:11.198421 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:11.198581 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:13.197422 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:13.198170 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:15.197598 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:15.199346 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:17.198152 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:17.198164 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:19.196866 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:19.197084 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:21.196477 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:21.196565 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:23.198299 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:23.199307 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:25.196368 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:25.196438 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:27.196794 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:27.198272 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:29.197440 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:29.197987 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:31.197448 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:31.197479 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:33.197423 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:33.198491 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:35.197270 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:35.198316 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:37.199217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:37.199216 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:39.197228 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:39.198903 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:41.196543 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:41.197144 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:43.196069 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:43.196073 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:45.196510 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:45.196524 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:47.196945 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:47.200022 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:49.197709 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:49.197721 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:51.197853 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:51.197883 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:53.196794 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:53.196875 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:55.196470 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:55.196478 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:57.196505 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:57.196502 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:59.196608 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:45:59.196791 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:01.197881 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:01.198123 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:03.197452 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:03.198583 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:05.198333 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:05.198447 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:07.196820 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:07.197257 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:09.198152 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:09.198680 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:11.197312 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:11.197495 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:13.196159 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:13.196160 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:15.196507 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:15.196952 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:17.197610 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:17.197656 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:19.197345 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:19.197348 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:21.196631 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:21.196629 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:23.197751 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:23.198413 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:25.198494 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:25.198503 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:27.197142 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:27.197141 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:29.197562 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:29.197878 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:31.197827 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:31.197968 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:33.196026 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:33.196211 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:35.196049 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:35.196154 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:37.199397 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:37.199407 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:39.197325 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:39.197429 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:41.196354 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:41.196443 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:43.197665 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:43.197746 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:45.196958 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:45.197336 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:47.199545 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:47.199657 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:49.199030 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:49.199093 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:51.197641 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:51.197668 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:53.198126 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:53.198169 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:55.197825 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:55.197857 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:57.197914 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:57.197935 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:59.196134 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:46:59.196737 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:01.197019 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:01.197395 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:03.197846 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:03.197887 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:05.196519 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:05.198327 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:07.197524 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:07.197699 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:09.196782 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:09.196870 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:11.197900 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:11.198024 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:13.196216 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:13.199198 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:15.196613 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:15.196896 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:17.197616 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:17.197804 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:19.196510 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:19.196623 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:21.195902 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:21.195904 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:23.198032 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:23.198040 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:25.198094 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:25.199349 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:27.197994 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:27.198074 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:29.196586 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:29.196908 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:31.197188 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:31.197313 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:33.198350 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:33.198411 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:35.198227 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:35.198248 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:37.195850 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:37.195852 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:39.196806 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:39.196813 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:41.196654 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:41.196944 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:43.197029 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:43.197434 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:45.197612 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:45.197702 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:47.197735 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:47.197900 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:49.199781 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:49.199781 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:51.199262 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:51.199345 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:53.196081 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:53.196168 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:55.197603 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:55.197674 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:57.198284 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:57.198294 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:59.197351 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:47:59.197354 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:01.195778 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:01.195789 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:03.196790 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:03.197213 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:05.198944 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:05.198945 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:07.197124 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:07.197142 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:09.197747 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:09.197867 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:11.199149 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:11.199388 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:13.196013 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:13.196125 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:15.197384 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:15.198771 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:17.196496 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:17.196578 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:19.196065 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:19.196144 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:21.195982 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:21.195982 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:23.195482 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:23.196009 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:25.196391 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:25.197479 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:27.197362 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:27.197801 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:29.197891 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:29.198340 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:31.196524 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:31.196525 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:33.197568 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:33.197572 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:35.197367 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:35.197540 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:37.198718 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:37.198852 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:39.198309 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:39.198420 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:41.196311 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:41.196514 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:43.197696 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:43.197760 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:45.197422 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:45.197542 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:47.196167 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:47.196421 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:49.196329 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:49.197114 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:51.197397 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:51.197478 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:53.200002 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:53.200000 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:55.196090 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:55.196168 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:57.197138 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:57.201561 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:59.197276 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:48:59.197528 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:01.197339 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:01.197339 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:03.197975 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:03.198052 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:05.197617 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:05.197692 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:07.197800 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:07.197893 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:09.195941 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:09.196059 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:11.199182 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:11.199328 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:13.196068 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:13.196109 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:15.198248 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:15.199483 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:17.196381 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:17.196488 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:19.198071 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:19.198398 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:21.199569 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:21.199582 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:23.195582 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:23.195725 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:25.196615 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:25.196616 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:27.204362 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:27.204443 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:29.197197 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:29.197388 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:31.195690 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:31.196051 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:33.197421 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:33.197493 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:35.195454 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:35.196384 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:37.197360 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:37.197971 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:39.197960 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:39.197962 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:41.195956 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:41.196205 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:43.197453 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:43.197490 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:45.196218 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:45.196393 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:45.233829 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready Jan 17 19:49:45.233: INFO: Unexpected error: Failed waiting for StatefulSet pod failover.: <*errors.errorString | 0xc000406fb0>: { s: "timed out waiting for the condition", } I0117 19:49:45.233831 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready Jan 17 19:49:45.234: FAIL: Failed waiting for StatefulSet pod failover.: timed out waiting for the condition Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run(0xc000124080, {0x26fb380?, 0xc000c93a00}, 0xc000880000, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:93 +0xc7d sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func6() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:222 +0x7d2 Jan 17 19:49:45.234: INFO: deleting StatefulSet "azuredisk-7525"/"azuredisk-volume-tester-2vzkx" Jan 17 19:49:45.314: INFO: Unexpected error: <*errors.errorString | 0xc0000ff030>: { s: "resource name may not be empty", } Jan 17 19:49:45.314: FAIL: resource name may not be empty Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Cleanup(0xc000eb5720, 0xd18c2e2800) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:225 +0x4d6 panic({0x203b9a0, 0xc00048d570}) /usr/local/go/src/runtime/panic.go:890 +0x262 k8s.io/kubernetes/test/e2e/framework.Fail({0xc000f34b40, 0x51}, {0xc000b4b220?, 0x2218fdb?, 0xc000b4b248?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/log.go:61 +0x145 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x26bff40, 0xc000406fb0}, {0xc00020fc90?, 0xc000c93a00?, 0xc000880000?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:76 +0x267 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:43 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run(0xc000124080, {0x26fb380?, 0xc000c93a00}, 0xc000880000, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:93 +0xc7d sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func6() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:222 +0x7d2 Jan 17 19:49:45.315: INFO: deleting StatefulSet "azuredisk-7525"/"azuredisk-volume-tester-l4vlr" Jan 17 19:49:45.392: INFO: Unexpected error: <*errors.errorString | 0xc000119da0>: { s: "resource name may not be empty", } Jan 17 19:49:45.392: FAIL: resource name may not be empty Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Cleanup(0xc000eb5450, 0xd18c2e2800) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:225 +0x4d6 panic({0x203b9a0, 0xc00048dc00}) /usr/local/go/src/runtime/panic.go:890 +0x262 k8s.io/kubernetes/test/e2e/framework.Fail({0xc000597980, 0x1e}, {0xc000b4aab0?, 0xc000597980?, 0xc000b4aad8?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/log.go:61 +0x145 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x26bff40, 0xc0000ff030}, {0x0?, 0x0?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:76 +0x267 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:43 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Cleanup(0xc000eb5720, 0xd18c2e2800) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:225 +0x4d6 panic({0x203b9a0, 0xc00048d570}) /usr/local/go/src/runtime/panic.go:890 +0x262 k8s.io/kubernetes/test/e2e/framework.Fail({0xc000f34b40, 0x51}, {0xc000b4b220?, 0x2218fdb?, 0xc000b4b248?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/log.go:61 +0x145 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x26bff40, 0xc000406fb0}, {0xc00020fc90?, 0xc000c93a00?, 0xc000880000?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:76 +0x267 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:43 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run(0xc000124080, {0x26fb380?, 0xc000c93a00}, 0xc000880000, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:93 +0xc7d sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func6() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:222 +0x7d2 Jan 17 19:49:45.392: INFO: deleting StorageClass azuredisk-7525-disk.csi.azure.com-dynamic-sc-w8xdl �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 19:49:45.442�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-7525" for this suite. �[38;5;243m01/17/23 19:49:45.442�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sAzDiskSchedulerExtender\s\[single\-az\]\sShould\sschedule\sand\sstart\sa\spod\swith\smultiple\spersistent\svolume\srequests\swith\sreplicas\sand\sreschedule\son\sdeletion\.$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000924000) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 +0x12e sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run.func1(0xc000924000) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:66 +0x8f created by sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:62 +0x20d There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e25a0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc0005804a0?, 0xc000da3f08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc000c45cb0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc0005804a0?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T19:49:45.488087327Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T19:49:45.492019504Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T19:49:45.607117394Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T19:49:45.680602423Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:258 2023-01-17T19:49:45.754972393Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T19:49:45.828432518Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T19:49:45.869098628Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T19:49:45.869280383Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:303 2023-01-17T19:49:45.869346412Z &{Text:setting up the statefulset Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T19:49:45.869579074Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T19:49:45.869641351Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:303 2023-01-17T19:49:45.86970382Z &{Text:setting up the statefulset Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T20:10:56.502863261Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T20:10:56.503203369Z &{Text:Destroying namespace "azuredisk-4808" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 19:49:45.488�[0m Jan 17 19:49:45.488: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 19:49:45.492�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 19:49:45.607�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 19:49:45.68�[0m I0117 19:49:45.754656 16300 azuredisk_driver.go:52] Using azure disk driver: disk.csi.azure.com �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 19:49:45.754�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 19:49:45.828�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 19:49:45.869�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 19:49:45.869�[0m �[1mSTEP:�[0m setting up the statefulset �[38;5;243m01/17/23 19:49:45.869�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 19:49:45.869�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 19:49:45.869�[0m �[1mSTEP:�[0m setting up the statefulset �[38;5;243m01/17/23 19:49:45.869�[0m I0117 19:49:45.949968 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:45.965001 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:47.991457 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:48.008615 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:49.989155 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:50.003296 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:51.989345 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:52.005105 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:53.990169 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:54.002967 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:55.988968 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:56.003735 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:57.988954 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:58.004325 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:49:59.990991 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:00.003639 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:01.989538 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:02.005107 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:03.988759 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:04.003784 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:05.989786 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:06.003871 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:07.988621 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:08.003942 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:09.989775 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:10.003887 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:11.989938 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:12.003653 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:13.988537 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:14.004122 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:15.989712 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:16.002978 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:17.989407 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:18.004170 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:19.990001 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:20.003391 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:21.988721 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:22.003693 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:23.988462 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:24.003810 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:25.988418 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:26.003704 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:27.988445 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:28.008926 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:29.991018 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:30.003970 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:31.989502 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:32.004459 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:33.993598 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:34.003908 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:35.990390 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:36.003677 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:37.997223 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:38.004734 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:39.990708 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:40.004169 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:41.989718 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:42.004846 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:43.988373 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:44.003968 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:45.989796 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:46.003890 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:47.989861 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:48.004179 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:49.989686 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:50.003603 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:51.990618 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:52.003228 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:53.989079 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:54.009955 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:55.990212 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:56.003686 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:57.990305 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:58.003677 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:50:59.990474 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:00.003897 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:01.990004 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:02.002806 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:03.989488 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:04.004233 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:05.990160 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:06.002899 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:07.990118 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:08.003492 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:09.990377 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:10.003345 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:11.989497 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:12.003472 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:13.989646 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:14.012588 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:15.989345 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:16.003935 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:17.989615 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:18.003828 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:19.990117 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:20.003585 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:21.988450 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:22.004236 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:23.989865 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:24.002865 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:25.988808 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:26.003783 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:27.988239 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:28.003279 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:29.988505 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:30.003425 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:31.994021 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:32.003229 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:33.988053 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:34.003798 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:35.989584 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:36.003704 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:37.989503 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:38.003908 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:39.990060 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:40.003416 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:41.990140 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:42.003967 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:43.988550 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:44.004408 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:45.989263 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:46.003035 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:47.989668 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:48.003033 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:49.989097 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:50.003231 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:51.990203 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:52.003124 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:53.989865 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:54.003341 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:55.989398 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:56.003355 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:57.989104 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:58.002732 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:51:59.989902 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:00.003994 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:01.990427 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:02.003407 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:03.998059 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:04.005660 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:05.988273 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:06.003580 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:07.988616 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:08.003676 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:09.988516 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:10.003335 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:11.989755 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:12.003048 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:13.989704 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:14.004276 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:15.988760 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:16.006307 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:17.989296 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:18.003653 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:19.989685 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:20.003140 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:21.988254 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:22.003165 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:23.990531 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:24.003730 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:25.994213 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:26.003911 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:27.989570 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:28.003735 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:29.988628 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:30.003458 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:31.988543 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:32.003408 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:33.989134 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:34.003951 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:35.988540 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:36.014262 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:37.988830 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:38.003603 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:39.988394 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:40.003582 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:41.988843 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:42.003255 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:43.987911 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:44.003947 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:45.989469 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:46.002523 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:48.001423 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:48.002954 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:49.989018 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:50.003185 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:51.989949 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:52.004765 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:53.989856 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:54.004831 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:55.989717 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:56.004038 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:57.989741 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:58.004006 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:52:59.989202 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:00.003645 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:01.989275 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:02.002779 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:03.989479 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:04.012341 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:05.990622 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:06.003546 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:07.989443 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:08.003442 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:09.988533 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:10.004307 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:11.990509 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:12.002735 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:13.990003 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:14.003890 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:15.988370 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:16.003674 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:17.989430 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:18.003460 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:19.989261 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:20.003557 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:21.990180 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:22.002832 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:23.993208 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:24.014867 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:25.988976 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:26.003442 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:27.989521 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:28.003574 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:29.989203 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:30.003122 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:31.990089 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:32.002918 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:33.990020 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:34.003291 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:35.991190 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:36.003527 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:37.988809 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:38.005711 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:39.991046 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:40.003712 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:41.990497 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:42.003432 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:43.990958 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:44.003643 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:45.990270 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:46.003650 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:47.990670 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:48.003622 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:49.990510 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:50.003442 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:51.989444 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:52.003036 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:53.989149 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:54.003501 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:55.988387 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:56.003612 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:57.988866 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:58.003575 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:53:59.989924 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:00.003312 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:01.989082 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:02.003940 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:03.989030 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:04.005486 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:05.987846 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:06.003816 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:07.988763 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:08.003314 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:09.990453 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:10.003141 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:11.991583 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:12.003760 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:13.988588 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:14.003685 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:15.990214 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:16.003024 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:17.991180 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:18.002454 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:19.988585 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:20.003194 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:21.988528 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:22.003484 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:23.988944 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:24.003420 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:25.988881 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:26.003257 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:27.990038 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:28.003556 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:29.988777 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:30.003143 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:31.989745 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:32.004178 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:33.990393 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:34.004002 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:35.989100 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:36.003574 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:37.990279 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:38.003703 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:39.989503 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:40.003371 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:41.990406 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:42.002662 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:43.989763 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:44.003228 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:45.990485 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:46.002921 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:47.990053 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:48.003984 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:49.988431 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:50.003335 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:51.990424 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:52.003321 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:53.989079 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:54.003649 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:55.988962 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:56.003450 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:57.988769 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:58.003321 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:54:59.989008 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:00.003799 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:01.988532 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:02.004068 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:03.989000 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:04.004139 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:05.988878 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:06.003012 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:07.990308 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:08.002854 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:09.989920 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:10.002959 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:11.988804 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:12.003460 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:13.989837 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:14.002977 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:15.989907 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:16.004051 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:17.990821 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:18.003869 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:19.988428 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:20.003604 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:21.989746 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:22.003514 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:23.989593 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:24.003340 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:25.990443 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:26.003383 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:27.989539 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:28.003227 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:29.988276 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:30.003299 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:31.988025 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:32.003500 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:33.988502 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:34.003104 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:35.989887 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:36.004021 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:37.988463 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:38.004595 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:39.989520 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:40.003875 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:41.990617 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:42.003662 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:43.988280 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:44.003882 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:45.988936 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:46.004111 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:47.990604 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:48.003743 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:49.991258 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:50.002948 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:51.988892 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:52.002854 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:53.989684 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:54.003806 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:55.988476 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:56.004036 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:57.989626 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:58.006093 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:55:59.988916 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:00.003357 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:01.997133 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:02.002670 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:03.994050 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:04.003356 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:05.990942 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:06.003769 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:07.988566 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:08.003261 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:09.990494 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:10.003440 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:11.989658 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:12.003514 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:13.989344 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:14.014834 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:15.990056 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:16.003599 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:17.992251 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:18.003373 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:19.988381 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:20.003511 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:21.989700 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:22.003494 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:23.991030 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:24.003162 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:25.989605 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:26.003379 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:27.990999 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:28.003117 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:29.988264 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:30.003560 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:31.990553 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:32.004022 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:33.989944 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:34.006081 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:35.990985 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:36.002993 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:37.988711 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:38.003264 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:39.988929 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:40.002951 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:41.992029 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:42.003407 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:43.988244 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:44.012687 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:45.989364 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:46.003754 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:47.988603 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:48.003538 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:49.987584 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:50.003469 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:51.990465 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:52.003265 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:53.992820 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:54.003215 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:55.991310 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:56.002845 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:57.989114 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:58.003223 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:56:59.989101 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:00.003327 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:01.990015 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:02.003838 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:03.988986 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:04.004082 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:05.988906 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:06.003609 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:07.990097 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:08.003905 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:09.989073 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:10.002811 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:11.990279 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:12.003868 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:13.990363 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:14.003613 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:15.994068 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:16.003744 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:17.989754 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:18.003208 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:19.989345 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:20.003888 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:21.990498 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:22.002936 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:23.989102 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:24.004292 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:25.990843 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:26.003395 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:27.989141 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:28.003589 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:29.988209 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:30.003148 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:31.990217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:32.007527 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:33.988717 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:34.004971 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:35.990337 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:36.004504 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:37.990261 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:38.003025 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:39.988187 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:40.003899 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:41.990304 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:42.003517 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:43.988425 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:44.003205 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:45.990718 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:46.003905 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:47.989158 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:48.003154 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:49.990219 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:50.002595 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:51.988287 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:52.003249 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:53.990584 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:54.003731 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:55.988995 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:56.003978 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:57.990108 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:58.003849 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:57:59.988693 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:00.003867 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:01.988990 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:02.003699 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:03.988701 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:04.003490 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:05.989054 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:06.003871 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:07.989389 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:08.002809 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:09.989831 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:10.004436 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:11.989296 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:12.006105 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:13.988998 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:14.005527 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:15.989930 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:16.003499 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:17.989966 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:18.003386 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:19.989518 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:20.003250 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:21.989442 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:22.003547 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:23.989608 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:24.004661 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:25.989501 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:26.003162 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:27.989095 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:28.003957 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:29.989647 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:30.003270 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:31.989522 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:32.003728 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:33.989107 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:34.004096 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:35.988536 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:36.004319 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:37.990735 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:38.002810 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:39.990323 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:40.004052 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:41.989918 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:42.003259 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:43.997178 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:44.003549 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:45.989805 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:46.003480 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:47.989147 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:48.003436 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:49.990796 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:50.002662 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:51.988837 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:52.004076 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:53.990894 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:54.003995 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:55.990411 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:56.002913 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:57.989461 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:58.003662 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:58:59.988583 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:00.004223 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:01.988817 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:02.004121 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:03.988409 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:04.008279 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:05.992218 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:06.003387 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:07.988338 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:08.003628 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:09.988547 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:10.006572 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:11.988369 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:12.003688 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:13.989278 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:14.003718 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:15.988762 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:16.006434 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:17.990077 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:18.003068 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:19.987913 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:20.003630 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:21.987630 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:22.003755 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:23.995868 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:24.003245 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:25.988887 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:26.003716 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:27.989578 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:28.008381 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:29.989140 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:30.010945 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:31.988312 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:32.003832 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:33.989852 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:34.004788 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:35.989371 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:36.003572 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:37.989409 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:38.003541 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:39.988265 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:40.003759 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:41.988886 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:42.003909 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:43.990981 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:44.003778 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:45.989254 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:46.005214 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 19:59:46.029098 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready Jan 17 19:59:46.029: INFO: Unexpected error: <*errors.errorString | 0xc000406fb0>: { s: "timed out waiting for the condition", } Jan 17 19:59:46.029: FAIL: timed out waiting for the condition Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000924000) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 +0x12e sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run.func1(0xc000924000) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:66 +0x8f created by sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:62 +0x20d I0117 19:59:46.042924 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready Jan 17 19:59:46.042: INFO: Unexpected error: <*errors.errorString | 0xc000406fb0>: { s: "timed out waiting for the condition", } Jan 17 19:59:46.043: FAIL: timed out waiting for the condition Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc0009241e0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:121 +0x12e sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run.func1(0xc0009241e0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:66 +0x8f created by sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:62 +0x20d Jan 17 19:59:56.089: INFO: Deleting all pods with map[group:delete-for-failover] labels in namespace azuredisk-4808 I0117 20:00:56.219669 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:00:56.219668 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:00:58.260262 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:00:58.260631 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:00.261353 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:00.262654 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:02.260223 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:02.260623 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:04.257934 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:04.258353 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:06.260510 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:06.260643 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:08.259427 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:08.259426 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:10.260465 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:10.261092 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:12.263274 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:12.263999 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:14.259364 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:14.259395 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:16.264993 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:16.267601 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:18.259898 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:18.259970 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:20.259640 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:20.259638 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:22.258779 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:22.258777 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:24.260205 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:24.260458 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:26.258162 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:26.258163 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:28.259465 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:28.259541 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:30.258146 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:30.258214 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:32.259163 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:32.259293 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:34.258378 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:34.258381 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:36.259873 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:36.260213 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:38.259241 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:38.259275 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:40.259958 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:40.259963 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:42.257989 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:42.258196 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:44.257944 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:44.257943 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:46.257597 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:46.262032 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:48.258671 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:48.258904 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:50.262179 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:50.262181 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:52.263102 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:52.264082 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:54.258505 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:54.259164 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:56.260249 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:56.262395 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:58.258427 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:01:58.259065 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:00.260412 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:00.260839 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:02.260209 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:02.260221 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:04.258117 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:04.258229 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:06.259055 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:06.259058 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:08.260243 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:08.260497 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:10.261373 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:10.261683 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:12.260711 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:12.262380 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:14.260871 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:14.261618 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:16.262106 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:16.262250 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:18.258166 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:18.258314 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:20.259485 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:20.260065 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:22.262087 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:22.262335 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:24.259257 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:24.259292 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:26.259340 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:26.259548 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:28.260209 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:28.260929 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:30.259795 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:30.259794 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:32.259060 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:32.259615 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:34.260685 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:34.260705 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:36.258559 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:36.258790 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:38.260662 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:38.262007 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:40.259919 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:40.260227 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:42.259994 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:42.260907 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:44.258951 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:44.260197 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:46.258482 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:46.258586 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:48.259409 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:48.261709 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:50.258339 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:50.259497 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:52.260408 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:52.261189 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:54.259988 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:54.260176 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:56.259629 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:56.259855 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:58.260329 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:02:58.261095 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:00.259244 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:00.259402 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:02.260033 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:02.260032 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:04.260577 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:04.260766 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:06.261152 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:06.261119 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:08.271520 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:08.272187 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:10.262764 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:10.263597 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:12.260816 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:12.261037 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:14.262568 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:14.262566 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:16.258161 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:16.258163 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:18.260579 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:18.260581 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:20.259104 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:20.260227 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:22.259382 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:22.259909 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:24.259384 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:24.259384 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:26.258791 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:26.259106 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:28.261088 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:28.261087 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:30.261384 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:30.261575 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:32.260656 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:32.260657 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:34.261845 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:34.262041 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:36.261015 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:36.261211 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:38.260641 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:38.260825 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:40.259306 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:40.260243 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:42.258674 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:42.258913 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:44.260176 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:44.261129 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:46.260121 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:46.260118 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:48.258774 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:48.258869 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:50.258596 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:50.258808 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:52.259075 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:52.259246 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:54.261390 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:54.262484 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:56.259112 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:56.260329 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:58.259757 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:03:58.259941 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:00.261637 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:00.262161 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:02.260265 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:02.260305 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:04.259651 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:04.259945 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:06.259954 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:06.259959 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:08.259578 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:08.259578 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:10.259759 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:10.259763 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:12.259646 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:12.259976 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:14.262580 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:14.262682 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:16.257874 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:16.258097 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:18.260752 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:18.260829 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:20.260367 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:20.260433 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:22.259085 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:22.259136 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:24.259728 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:24.259882 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:26.259677 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:26.259683 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:28.259848 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:28.259871 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:30.261563 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:30.261655 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:32.259895 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:32.260047 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:34.259604 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:34.261105 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:36.259302 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:36.259301 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:38.260473 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:38.260476 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:40.261037 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:40.261038 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:42.259184 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:42.259354 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:44.268641 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:44.268948 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:46.259202 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:46.259203 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:48.259349 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:48.260700 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:50.260164 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:50.260385 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:52.261635 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:52.261962 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:54.260004 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:54.260006 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:56.259056 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:56.259101 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:58.259838 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:04:58.259917 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:00.258887 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:00.259033 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:02.260401 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:02.260564 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:04.261145 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:04.261647 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:06.258964 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:06.259511 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:08.260238 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:08.260353 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:10.258379 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:10.258914 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:12.259245 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:12.260517 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:14.258137 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:14.259191 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:16.258418 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:16.258429 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:18.259639 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:18.259838 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:20.260195 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:20.260199 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:22.259328 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:22.259928 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:24.259669 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:24.259685 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:26.261282 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:26.261287 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:28.259351 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:28.259506 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:30.258865 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:30.259104 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:32.260077 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:32.260087 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:34.260010 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:34.260082 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:36.259963 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:36.260421 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:38.259773 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:38.260591 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:40.262875 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:40.263647 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:42.261387 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:42.262833 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:44.260548 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:44.260917 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:46.258582 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:46.258700 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:48.259023 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:48.259694 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:50.260754 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:50.260928 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:52.259573 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:52.259814 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:54.259382 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:54.259390 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:56.259873 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:56.260034 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:58.259035 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:05:58.259621 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:00.261211 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:00.261243 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:02.260723 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:02.260788 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:04.258996 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:04.259025 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:06.260647 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:06.261083 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:08.259222 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:08.259469 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:10.261075 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:10.261075 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:12.259840 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:12.259843 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:14.265972 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:14.266055 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:16.259217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:16.259506 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:18.259003 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:18.259032 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:20.258804 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:20.259021 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:22.258325 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:22.258611 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:24.258965 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:24.258967 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:26.257797 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:26.258034 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:28.260241 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:28.260411 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:30.261406 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:30.261447 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:32.260164 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:32.260333 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:34.258949 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:34.258951 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:36.259265 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:36.259269 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:38.259301 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:38.259729 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:40.257902 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:40.257904 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:42.263983 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:42.264314 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:44.261058 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:44.261255 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:46.259854 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:46.259908 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:48.258686 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:48.258702 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:50.261202 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:50.262223 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:52.259443 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:52.259444 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:54.260023 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:54.260091 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:56.259274 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:56.259283 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:58.257830 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:06:58.257830 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:00.260433 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:00.260532 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:02.259409 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:02.259785 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:04.260183 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:04.260183 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:06.259944 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:06.260265 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:08.259945 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:08.260057 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:10.259662 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:10.259745 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:12.260147 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:12.260708 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:14.266160 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:14.266247 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:16.259519 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:16.259697 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:18.258340 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:18.258537 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:20.260505 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:20.260861 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:22.259975 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:22.260357 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:24.259959 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:24.260144 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:26.259480 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:26.259594 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:28.259497 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:28.259501 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:30.260361 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:30.260589 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:32.258461 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:32.258658 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:34.258405 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:34.258639 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:36.260132 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:36.260204 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:38.258514 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:38.259033 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:40.260766 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:40.261005 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:42.260065 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:42.260067 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:44.260141 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:44.260240 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:46.259600 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:46.259620 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:48.259818 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:48.259952 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:50.258649 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:50.258665 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:52.259711 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:52.259811 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:54.259328 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:54.259355 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:56.259444 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:56.259797 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:58.260024 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:07:58.260023 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:00.259680 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:00.259691 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:02.260627 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:02.260989 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:04.260027 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:04.260119 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:06.264900 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:06.264944 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:08.259973 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:08.260148 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:10.260801 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:10.260805 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:12.258872 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:12.258894 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:14.259662 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:14.259799 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:16.264519 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:16.264546 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:18.259521 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:18.259667 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:20.259842 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:20.259843 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:22.258426 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:22.258592 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:24.266209 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:24.266217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:26.259490 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:26.259560 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:28.260492 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:28.260797 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:30.259606 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:30.259604 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:32.260741 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:32.261082 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:34.260064 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:34.260098 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:36.260078 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:36.260079 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:38.257781 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:38.257792 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:40.258312 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:40.258408 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:42.259294 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:42.259305 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:44.265170 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:44.265273 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:46.259121 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:46.259146 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:48.260398 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:48.260580 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:50.258834 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:50.258912 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:52.261216 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:52.261217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:54.258337 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:54.258903 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:56.260803 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:56.260811 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:58.259397 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:08:58.259544 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:00.262247 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:00.262301 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:02.261069 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:02.261071 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:04.258483 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:04.258629 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:06.261080 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:06.263172 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:08.259699 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:08.260103 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:10.259720 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:10.260890 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:12.261343 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:12.261426 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:14.257979 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:14.258256 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:16.258682 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:16.258683 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:18.262648 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:18.263130 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:20.259321 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:20.260546 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:22.260964 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:22.261035 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:24.260882 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:24.260969 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:26.259353 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:26.259431 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:28.259541 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:28.259635 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:30.259672 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:30.259714 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:32.258840 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:32.258847 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:34.260183 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:34.260207 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:36.264544 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:36.265527 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:38.259161 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:38.259156 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:40.260395 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:40.260802 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:42.259843 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:42.259870 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:44.260836 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:44.261645 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:46.259115 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:46.259676 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:48.260927 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:48.261074 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:50.258959 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:50.259020 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:52.259767 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:52.259873 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:54.260069 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:54.260358 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:56.259001 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:56.259078 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:58.260769 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:09:58.261858 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:00.259395 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:00.260173 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:02.260086 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:02.260217 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:04.259280 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:04.259704 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:06.259045 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:06.259241 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:08.257958 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:08.258245 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:10.259103 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:10.259636 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:12.261363 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:12.261425 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:14.259275 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:14.259276 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:16.260580 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:16.260581 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:18.258295 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:18.258700 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:20.259645 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:20.259707 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:22.259455 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:22.259475 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:24.258355 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:24.258474 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:26.259795 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:26.260459 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:28.260307 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:28.260365 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:30.259371 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:30.260589 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:32.259606 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:32.260100 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:34.259485 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:34.259911 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:36.260539 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:36.261103 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:38.260039 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:38.260042 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:40.259182 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:40.259239 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:42.261533 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:42.261788 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:44.262143 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:44.262144 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:46.258598 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:46.258940 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:48.259094 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:48.259225 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:50.258581 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:50.258908 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:52.261228 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:52.261686 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:54.261200 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:54.261221 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:56.259903 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:56.260139 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:56.297870 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 20:10:56.297903 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready Jan 17 20:10:56.297: INFO: Unexpected error: Failed waiting for StatefulSet pod failover.: <*errors.errorString | 0xc000406fb0>: { s: "timed out waiting for the condition", } Jan 17 20:10:56.298: FAIL: Failed waiting for StatefulSet pod failover.: timed out waiting for the condition Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run(0xc0006c4380, {0x26fb380?, 0xc000d12b60}, 0xc000bec2c0, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:93 +0xc7d sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func7() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:263 +0x872 Jan 17 20:10:56.298: INFO: deleting StatefulSet "azuredisk-4808"/"azuredisk-volume-tester-fkjbl" Jan 17 20:10:56.379: INFO: Unexpected error: <*errors.errorString | 0xc000027520>: { s: "resource name may not be empty", } Jan 17 20:10:56.379: FAIL: resource name may not be empty Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Cleanup(0xc0009241e0, 0xd18c2e2800) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:225 +0x4d6 panic({0x203b9a0, 0xc00068dab0}) /usr/local/go/src/runtime/panic.go:890 +0x262 k8s.io/kubernetes/test/e2e/framework.Fail({0xc0009a1b60, 0x51}, {0xc000acf220?, 0x2218fdb?, 0xc000acf248?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/log.go:61 +0x145 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x26bff40, 0xc000406fb0}, {0xc000026410?, 0xc000d12b60?, 0xc000bec2c0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:76 +0x267 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:43 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run(0xc0006c4380, {0x26fb380?, 0xc000d12b60}, 0xc000bec2c0, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:93 +0xc7d sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func7() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:263 +0x872 Jan 17 20:10:56.379: INFO: deleting StatefulSet "azuredisk-4808"/"azuredisk-volume-tester-n655w" Jan 17 20:10:56.461: INFO: Unexpected error: <*errors.errorString | 0xc000784260>: { s: "resource name may not be empty", } Jan 17 20:10:56.462: FAIL: resource name may not be empty Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Cleanup(0xc000924000, 0xd18c2e2800) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:225 +0x4d6 panic({0x203b9a0, 0xc000290380}) /usr/local/go/src/runtime/panic.go:890 +0x262 k8s.io/kubernetes/test/e2e/framework.Fail({0xc000573b00, 0x1e}, {0xc000aceab0?, 0xc000573b00?, 0xc000acead8?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/log.go:61 +0x145 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x26bff40, 0xc000027520}, {0x0?, 0x0?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:76 +0x267 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:43 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Cleanup(0xc0009241e0, 0xd18c2e2800) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:225 +0x4d6 panic({0x203b9a0, 0xc00068dab0}) /usr/local/go/src/runtime/panic.go:890 +0x262 k8s.io/kubernetes/test/e2e/framework.Fail({0xc0009a1b60, 0x51}, {0xc000acf220?, 0x2218fdb?, 0xc000acf248?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/log.go:61 +0x145 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x26bff40, 0xc000406fb0}, {0xc000026410?, 0xc000d12b60?, 0xc000bec2c0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:76 +0x267 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/expect.go:43 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingOnFailoverMultiplePV).Run(0xc0006c4380, {0x26fb380?, 0xc000d12b60}, 0xc000bec2c0, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_on_failover_multiple_pv_perf_tester.go:93 +0xc7d sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func7() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:263 +0x872 Jan 17 20:10:56.462: INFO: deleting StorageClass azuredisk-4808-disk.csi.azure.com-dynamic-sc-pffgm �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 20:10:56.502�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-4808" for this suite. �[38;5;243m01/17/23 20:10:56.503�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sAzDiskSchedulerExtender\s\[single\-az\]\sShould\sschedule\sand\sstart\sa\spod\swith\smultiple\spersistent\svolume\srequests\.\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000ba7698, {0x26fb380?, 0xc0005029c0}, 0xc000d2a000, {0x7ff9f557a358, 0xc0007843c0}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicMultipleVolumes(0xc000ba7b90, {0x26fb380, 0xc0005029c0}, 0xc000d2a000?, {0x7ff9f557a358, 0xc0007843c0}, {0x220ec17?, 0x20?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:80 +0x2a5 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingWithMultiplePVTest).Run(0xc000ba7b80, {0x26fb380, 0xc0005029c0}, 0x4?, {0x220ec17?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_with_multiple_pv_tester.go:36 +0x65 sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func5() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:181 +0x6f7 There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e25a0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc0001b26b0?, 0xc000b02f08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc0007024b0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc0001b26b0?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T19:23:32.073438972Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T19:23:32.075369073Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T19:23:32.206308668Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T19:23:32.280480825Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T19:23:32.355448232Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T19:23:32.355727937Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T19:23:32.395308452Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T19:23:32.39544502Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T19:23:32.438631696Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T19:28:34.37404622Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T19:28:34.374531482Z &{Text:Destroying namespace "azuredisk-131" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 19:23:32.073�[0m Jan 17 19:23:32.073: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 19:23:32.075�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 19:23:32.206�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 19:23:32.28�[0m I0117 19:23:32.355272 16300 azuredisk_driver.go:52] Using azure disk driver: disk.csi.azure.com �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 19:23:32.355�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 19:23:32.355�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 19:23:32.395�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 19:23:32.395�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 19:23:32.438�[0m Jan 17 19:23:32.438: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-6d4jw] to have phase Bound Jan 17 19:23:32.477: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:34.517: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:36.558: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:38.604: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:40.643: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:42.683: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:44.723: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:46.763: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:48.803: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:50.847: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:52.886: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:54.930: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:56.969: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:23:59.007: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:01.047: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:03.087: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:05.125: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:07.165: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:09.214: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:11.254: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:13.293: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:15.333: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:17.373: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:19.413: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:21.451: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:23.493: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:25.533: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:27.574: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:29.614: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:31.655: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:33.695: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:35.734: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:37.773: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:39.814: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:41.853: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:43.893: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:45.933: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:47.975: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:50.015: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:52.054: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:54.095: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:56.136: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:24:58.177: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:00.219: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:02.258: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:04.297: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:06.337: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:08.376: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:10.417: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:12.456: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:14.502: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:16.541: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:18.580: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:20.621: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:22.660: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:24.701: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:26.741: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:28.780: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:30.820: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:32.858: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:34.898: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:36.938: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:38.979: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:41.018: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:43.059: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:45.098: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:47.137: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:49.176: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:51.217: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:53.257: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:55.296: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:57.336: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:25:59.376: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:01.417: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:03.456: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:05.499: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:07.538: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:09.578: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:11.618: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:13.657: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:15.698: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:17.737: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:19.778: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:21.817: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:23.860: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:25.899: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:27.939: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:29.979: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:32.017: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:34.056: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:36.097: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:38.137: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:40.177: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:42.219: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:44.258: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:46.296: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:48.335: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:50.375: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:52.415: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:54.455: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:56.495: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:26:58.535: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:00.576: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:02.617: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:04.656: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:06.696: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:08.735: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:10.774: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:12.815: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:14.854: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:16.894: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:18.933: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:20.972: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:23.011: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:25.054: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:27.094: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:29.133: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:31.172: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:33.211: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:35.252: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:37.290: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:39.330: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:41.370: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:43.409: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:45.448: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:47.488: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:49.526: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:51.565: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:53.605: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:55.644: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:57.684: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:27:59.723: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:01.763: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:03.804: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:05.842: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:07.884: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:09.936: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:11.976: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:14.014: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:16.054: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:18.093: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:20.132: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:22.173: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:24.212: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:26.252: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:28.291: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:30.330: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:32.372: INFO: PersistentVolumeClaim pvc-6d4jw found but phase is Pending instead of Bound. Jan 17 19:28:34.372: INFO: Unexpected error: <*errors.errorString | 0xc0001b2930>: { s: "PersistentVolumeClaims [pvc-6d4jw] not all in phase Bound within 5m0s", } Jan 17 19:28:34.373: FAIL: PersistentVolumeClaims [pvc-6d4jw] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000ba7698, {0x26fb380?, 0xc0005029c0}, 0xc000d2a000, {0x7ff9f557a358, 0xc0007843c0}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicMultipleVolumes(0xc000ba7b90, {0x26fb380, 0xc0005029c0}, 0xc000d2a000?, {0x7ff9f557a358, 0xc0007843c0}, {0x220ec17?, 0x20?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:80 +0x2a5 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*AzDiskSchedulerExtenderPodSchedulingWithMultiplePVTest).Run(0xc000ba7b80, {0x26fb380, 0xc0005029c0}, 0x4?, {0x220ec17?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/azdiskschedulerextender_pod_scheduling_with_multiple_pv_tester.go:36 +0x65 sigs.k8s.io/azuredisk-csi-driver/test/e2e.schedulerExtenderTests.func5() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/azdiskschedulerextender_test.go:181 +0x6f7 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 19:28:34.374�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-131" for this suite. �[38;5;243m01/17/23 19:28:34.374�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sShould\screate\sand\sattach\sa\svolume\swith\sadvanced\sperfProfile\s\[enableBursting\]\[disk\.csi\.azure\.com\]\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000a2b838, {0x26fb380?, 0xc0010f4820}, 0xc000a6d080, {0x7ff9f557a358, 0xc0004d4f30}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000a2b9d8, {0x26fb380, 0xc0010f4820}, 0x7ffa1fb67588?, {0x7ff9f557a358, 0xc0004d4f30}, 0x7ff9f43be298?, {0x220ec17?, 0x7ffa1fb5d5b8?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedCmdVolumeTest).Run(0xc000a2bcf8, {0x26fb380, 0xc0010f4820}, 0x11?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_cmd_volume_tester.go:39 +0x13c sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func5() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:272 +0x725 There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc0003a7180?, 0xc000d29f08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc0005224b0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc0003a7180?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T20:54:15.872069735Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T20:54:15.873846398Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T20:54:15.993657945Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T20:54:16.067407418Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T20:54:16.543241196Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T20:54:16.54338869Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T20:54:16.584049033Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T20:54:16.584197081Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T20:54:16.628735509Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T20:59:18.599713734Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T20:59:18.60001671Z &{Text:Destroying namespace "azuredisk-7182" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 20:54:15.872�[0m Jan 17 20:54:15.872: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 20:54:15.873�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 20:54:15.993�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 20:54:16.067�[0m Jan 17 20:54:16.541: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 20:54:16.543�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 20:54:16.543�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 20:54:16.584�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 20:54:16.584�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 20:54:16.628�[0m Jan 17 20:54:16.628: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-bgmbn] to have phase Bound Jan 17 20:54:16.666: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:18.704: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:20.743: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:22.784: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:24.825: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:26.867: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:28.907: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:30.947: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:32.985: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:35.024: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:37.064: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:39.104: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:41.146: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:43.186: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:45.227: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:47.269: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:49.309: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:51.350: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:53.390: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:55.429: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:57.470: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:54:59.512: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:01.551: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:03.590: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:05.629: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:07.669: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:09.709: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:11.749: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:13.788: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:15.826: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:17.867: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:19.908: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:21.949: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:23.989: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:26.030: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:28.071: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:30.111: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:32.152: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:34.192: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:36.234: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:38.274: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:40.314: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:42.355: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:44.395: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:46.435: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:48.475: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:50.515: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:52.557: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:54.603: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:56.643: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:55:58.682: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:00.722: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:02.762: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:04.802: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:06.841: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:08.882: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:10.925: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:12.965: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:15.005: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:17.045: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:19.083: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:21.122: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:23.163: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:25.203: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:27.242: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:29.282: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:31.322: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:33.363: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:35.402: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:37.443: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:39.484: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:41.524: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:43.564: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:45.604: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:47.644: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:49.684: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:51.722: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:53.761: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:55.801: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:57.840: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:56:59.898: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:01.939: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:03.979: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:06.029: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:08.070: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:10.110: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:12.149: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:14.189: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:16.229: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:18.270: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:20.311: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:22.360: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:24.400: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:26.441: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:28.483: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:30.523: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:32.564: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:34.603: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:36.643: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:38.682: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:40.723: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:42.764: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:44.804: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:46.843: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:48.882: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:50.924: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:52.963: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:55.003: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:57.041: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:57:59.081: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:01.120: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:03.168: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:05.207: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:07.246: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:09.286: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:11.327: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:13.367: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:15.406: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:17.445: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:19.484: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:21.523: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:23.563: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:25.601: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:27.642: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:29.681: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:31.721: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:33.764: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:35.803: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:37.842: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:39.882: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:41.923: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:43.961: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:46.002: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:48.042: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:50.083: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:52.123: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:54.163: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:56.202: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:58:58.242: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:59:00.280: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:59:02.320: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:59:04.359: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:59:06.398: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:59:08.440: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:59:10.481: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:59:12.519: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:59:14.558: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:59:16.597: INFO: PersistentVolumeClaim pvc-bgmbn found but phase is Pending instead of Bound. Jan 17 20:59:18.598: INFO: Unexpected error: <*errors.errorString | 0xc000f445a0>: { s: "PersistentVolumeClaims [pvc-bgmbn] not all in phase Bound within 5m0s", } Jan 17 20:59:18.598: FAIL: PersistentVolumeClaims [pvc-bgmbn] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000a2b838, {0x26fb380?, 0xc0010f4820}, 0xc000a6d080, {0x7ff9f557a358, 0xc0004d4f30}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000a2b9d8, {0x26fb380, 0xc0010f4820}, 0x7ffa1fb67588?, {0x7ff9f557a358, 0xc0004d4f30}, 0x7ff9f43be298?, {0x220ec17?, 0x7ffa1fb5d5b8?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedCmdVolumeTest).Run(0xc000a2bcf8, {0x26fb380, 0xc0010f4820}, 0x11?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_cmd_volume_tester.go:39 +0x13c sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func5() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:272 +0x725 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 20:59:18.599�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-7182" for this suite. �[38;5;243m01/17/23 20:59:18.6�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sShould\screate\sand\sattach\sa\svolume\swith\sbasic\sperfProfile\s\[enableBursting\]\[disk\.csi\.azure\.com\]\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000a27838, {0x26fb380?, 0xc000a0e820}, 0xc000e938c0, {0x7ff9f557a358, 0xc0004d4f30}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000a279d8, {0x26fb380, 0xc000a0e820}, 0x7ff9f6eb0cb8?, {0x7ff9f557a358, 0xc0004d4f30}, 0x7ff9f5e636e8?, {0x220ec17?, 0x7ffa1fb5df18?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedCmdVolumeTest).Run(0xc000a27cf8, {0x26fb380, 0xc000a0e820}, 0x11?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_cmd_volume_tester.go:39 +0x13c sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func4() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:234 +0x688 There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc0000c9c20?, 0xc000b48f08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc000522930?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc0000c9c20?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T20:49:13.162632618Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T20:49:13.166527985Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T20:49:13.287234181Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T20:49:13.361177513Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T20:49:13.853938574Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T20:49:13.854239874Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T20:49:13.901178997Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T20:49:13.901454147Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T20:49:13.946057001Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T20:54:15.83040351Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T20:54:15.830670495Z &{Text:Destroying namespace "azuredisk-661" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 20:49:13.162�[0m Jan 17 20:49:13.162: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 20:49:13.166�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 20:49:13.287�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 20:49:13.361�[0m Jan 17 20:49:13.852: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 20:49:13.853�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 20:49:13.854�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 20:49:13.901�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 20:49:13.901�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 20:49:13.946�[0m Jan 17 20:49:13.946: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-w7qql] to have phase Bound Jan 17 20:49:13.984: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:16.027: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:18.067: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:20.105: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:22.145: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:24.185: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:26.224: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:28.262: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:30.301: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:32.340: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:34.380: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:36.420: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:38.458: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:40.497: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:42.541: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:44.585: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:46.624: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:48.664: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:50.703: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:52.742: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:54.782: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:56.822: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:49:58.862: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:00.901: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:02.944: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:04.984: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:07.023: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:09.063: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:11.103: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:13.141: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:15.180: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:17.219: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:19.259: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:21.298: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:23.336: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:25.376: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:27.415: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:29.453: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:31.493: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:33.532: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:35.573: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:37.613: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:39.652: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:41.692: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:43.739: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:45.778: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:47.817: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:49.856: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:51.898: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:53.938: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:55.978: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:50:58.018: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:00.057: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:02.097: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:04.138: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:06.178: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:08.217: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:10.256: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:12.296: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:14.335: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:16.374: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:18.413: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:20.453: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:22.492: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:24.534: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:26.574: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:28.613: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:30.656: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:32.695: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:34.735: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:36.775: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:38.814: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:40.853: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:42.892: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:44.931: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:46.972: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:49.014: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:51.053: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:53.097: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:55.136: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:57.181: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:51:59.221: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:01.261: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:03.301: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:05.340: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:07.379: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:09.417: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:11.455: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:13.493: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:15.532: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:17.572: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:19.613: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:21.654: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:23.693: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:25.731: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:27.774: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:29.813: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:31.853: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:33.893: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:35.934: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:37.973: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:40.012: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:42.051: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:44.091: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:46.131: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:48.170: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:50.210: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:52.250: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:54.292: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:56.333: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:52:58.371: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:00.411: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:02.449: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:04.489: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:06.529: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:08.568: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:10.608: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:12.648: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:14.687: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:16.726: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:18.765: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:20.803: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:22.844: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:24.883: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:26.921: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:28.960: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:30.999: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:33.039: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:35.079: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:37.119: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:39.159: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:41.199: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:43.239: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:45.279: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:47.320: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:49.359: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:51.398: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:53.436: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:55.476: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:57.516: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:53:59.554: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:54:01.593: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:54:03.633: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:54:05.672: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:54:07.712: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:54:09.750: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:54:11.790: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:54:13.828: INFO: PersistentVolumeClaim pvc-w7qql found but phase is Pending instead of Bound. Jan 17 20:54:15.829: INFO: Unexpected error: <*errors.errorString | 0xc000f446f0>: { s: "PersistentVolumeClaims [pvc-w7qql] not all in phase Bound within 5m0s", } Jan 17 20:54:15.829: FAIL: PersistentVolumeClaims [pvc-w7qql] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000a27838, {0x26fb380?, 0xc000a0e820}, 0xc000e938c0, {0x7ff9f557a358, 0xc0004d4f30}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000a279d8, {0x26fb380, 0xc000a0e820}, 0x7ff9f6eb0cb8?, {0x7ff9f557a358, 0xc0004d4f30}, 0x7ff9f5e636e8?, {0x220ec17?, 0x7ffa1fb5df18?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedCmdVolumeTest).Run(0xc000a27cf8, {0x26fb380, 0xc000a0e820}, 0x11?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_cmd_volume_tester.go:39 +0x13c sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func4() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:234 +0x688 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 20:54:15.83�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-661" for this suite. �[38;5;243m01/17/23 20:54:15.83�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\screate\sa\sdeployment\sobject\,\swrite\sand\sread\sto\sit\,\sdelete\sthe\spod\sand\swrite\sand\sread\sto\sit\sagain\s\[kubernetes\.io\/azure\-disk\]\s\[disk\.csi\.azure\.com\]\s\[Windows\]\s\[csi\-azuredisk\-scheduler\-extender\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupDeployment(0xc000bc3c88, {0x26fb380?, 0xc0010f49c0}, 0xc000dc4000, {0x7ff9f557a358, 0xc0004d4f30}, {0x220ec17, 0x20}, 0xc000eb0480?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:149 +0x926 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedDeletePodTest).Run(0xc000bc3c78, {0x26fb380, 0xc0010f49c0}, 0x4?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_delete_pod_tester.go:43 +0xef sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func10() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:475 +0x56b There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc000025ce0?, 0xc000b43f08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc0007033b0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc000025ce0?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T21:09:25.404417748Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T21:09:25.406652003Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T21:09:25.530686794Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T21:09:25.60408412Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:140 2023-01-17T21:09:26.094023952Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T21:09:26.094157596Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:145 2023-01-17T21:09:26.133114379Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T21:09:26.133263702Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T21:09:26.174219206Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T21:14:28.050727648Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T21:14:28.051075528Z &{Text:Destroying namespace "azuredisk-6101" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 21:09:25.404�[0m Jan 17 21:09:25.404: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 21:09:25.406�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 21:09:25.53�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 21:09:25.604�[0m Jan 17 21:09:26.092: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 21:09:26.094�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 21:09:26.094�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 21:09:26.133�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 21:09:26.133�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 21:09:26.174�[0m Jan 17 21:09:26.174: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-cc4vs] to have phase Bound Jan 17 21:09:26.211: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:28.251: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:30.291: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:32.330: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:34.370: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:36.410: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:38.449: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:40.489: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:42.530: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:44.570: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:46.611: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:48.650: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:50.689: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:52.730: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:54.770: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:56.809: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:09:58.848: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:00.887: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:02.927: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:04.966: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:07.004: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:09.044: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:11.082: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:13.122: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:15.161: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:17.199: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:19.238: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:21.279: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:23.319: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:25.358: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:27.397: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:29.435: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:31.477: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:33.518: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:35.558: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:37.599: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:39.638: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:41.677: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:43.717: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:45.756: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:47.796: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:49.836: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:51.876: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:53.915: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:55.953: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:10:57.993: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:00.033: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:02.072: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:04.112: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:06.156: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:08.195: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:10.234: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:12.273: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:14.318: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:16.358: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:18.397: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:20.437: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:22.475: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:24.514: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:26.553: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:28.593: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:30.631: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:32.673: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:34.712: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:36.750: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:38.789: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:40.828: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:42.866: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:44.905: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:46.944: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:48.984: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:51.023: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:53.061: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:55.101: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:57.140: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:11:59.178: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:01.217: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:03.256: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:05.295: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:07.333: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:09.376: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:11.419: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:13.459: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:15.498: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:17.537: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:19.575: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:21.615: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:23.653: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:25.693: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:27.732: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:29.772: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:31.812: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:33.851: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:35.895: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:37.935: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:39.983: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:42.024: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:44.063: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:46.103: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:48.142: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:50.183: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:52.223: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:54.262: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:56.300: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:12:58.340: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:00.383: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:02.423: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:04.462: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:06.502: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:08.542: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:10.582: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:12.622: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:14.661: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:16.700: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:18.739: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:20.778: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:22.816: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:24.856: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:26.895: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:28.934: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:30.975: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:33.015: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:35.054: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:37.093: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:39.136: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:41.176: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:43.219: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:45.258: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:47.296: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:49.334: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:51.373: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:53.412: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:55.454: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:57.492: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:13:59.532: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:01.571: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:03.610: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:05.649: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:07.690: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:09.729: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:11.770: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:13.809: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:15.849: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:17.892: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:19.931: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:21.971: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:24.010: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:26.049: INFO: PersistentVolumeClaim pvc-cc4vs found but phase is Pending instead of Bound. Jan 17 21:14:28.049: INFO: Unexpected error: <*errors.errorString | 0xc0003a72b0>: { s: "PersistentVolumeClaims [pvc-cc4vs] not all in phase Bound within 5m0s", } Jan 17 21:14:28.050: FAIL: PersistentVolumeClaims [pvc-cc4vs] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupDeployment(0xc000bc3c88, {0x26fb380?, 0xc0010f49c0}, 0xc000dc4000, {0x7ff9f557a358, 0xc0004d4f30}, {0x220ec17, 0x20}, 0xc000eb0480?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:149 +0x926 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedDeletePodTest).Run(0xc000bc3c78, {0x26fb380, 0xc0010f49c0}, 0x4?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_delete_pod_tester.go:43 +0xef sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func10() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:475 +0x56b �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 21:14:28.05�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-6101" for this suite. �[38;5;243m01/17/23 21:14:28.051�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\screate\sa\spod\swith\smultiple\svolumes\s\[kubernetes\.io\/azure\-disk\]\s\[disk\.csi\.azure\.com\]\s\[Windows\]\s\[csi\-azuredisk\-scheduler\-extender\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc0005bf710, {0x26fb380?, 0xc000a0e340}, 0xc000a6c840, {0x7ff9f557a358, 0xc0004d4f30}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicMultipleVolumes(0xc0005bf8a8, {0x26fb380, 0xc000a0e340}, 0x0?, {0x7ff9f557a358, 0xc0004d4f30}, {0x220ec17?, 0xc0009d68d8?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:80 +0x2a5 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedPodWithMultiplePVsTest).Run(0xc0005bfc00, {0x26fb380, 0xc000a0e340}, 0x0?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_pod_with_multiple_pv.go:38 +0x133 sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func19() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:802 +0x7ac There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc000784990?, 0xc000af6f08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc000523230?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc000784990?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T21:39:43.333469468Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T21:39:43.335578002Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T21:39:43.452839833Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T21:39:43.527463953Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T21:39:44.018684481Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T21:39:44.018828899Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T21:39:44.058899345Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T21:39:44.059058879Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T21:39:44.100365504Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T21:44:46.009729921Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T21:44:46.010138274Z &{Text:Destroying namespace "azuredisk-3847" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 21:39:43.333�[0m Jan 17 21:39:43.333: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 21:39:43.335�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 21:39:43.452�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 21:39:43.527�[0m Jan 17 21:39:44.017: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 21:39:44.018�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 21:39:44.018�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 21:39:44.058�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 21:39:44.059�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 21:39:44.1�[0m Jan 17 21:39:44.100: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-44gjz] to have phase Bound Jan 17 21:39:44.137: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:39:46.177: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:39:48.218: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:39:50.260: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:39:52.299: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:39:54.338: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:39:56.378: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:39:58.418: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:00.456: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:02.496: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:04.534: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:06.574: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:08.614: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:10.654: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:12.710: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:14.750: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:16.790: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:18.830: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:20.871: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:22.913: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:24.952: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:26.993: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:29.033: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:31.073: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:33.113: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:35.153: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:37.192: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:39.230: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:41.270: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:43.310: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:45.348: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:47.387: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:49.427: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:51.467: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:53.508: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:55.547: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:57.588: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:40:59.627: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:01.666: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:03.706: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:05.744: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:07.783: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:09.822: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:11.862: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:13.909: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:15.949: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:17.988: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:20.027: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:22.068: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:24.108: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:26.147: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:28.187: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:30.226: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:32.266: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:34.305: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:36.345: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:38.384: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:40.429: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:42.468: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:44.507: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:46.547: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:48.586: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:50.626: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:52.664: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:54.703: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:56.743: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:41:58.782: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:00.822: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:02.860: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:04.901: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:06.941: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:08.983: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:11.021: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:13.066: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:15.106: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:17.144: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:19.184: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:21.224: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:23.264: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:25.304: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:27.344: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:29.382: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:31.422: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:33.461: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:35.501: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:37.541: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:39.580: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:41.621: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:43.661: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:45.700: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:47.739: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:49.778: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:51.818: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:53.857: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:55.902: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:57.942: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:42:59.982: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:02.022: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:04.062: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:06.101: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:08.140: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:10.181: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:12.220: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:14.261: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:16.301: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:18.341: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:20.381: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:22.422: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:24.462: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:26.503: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:28.544: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:30.584: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:32.623: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:34.661: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:36.700: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:38.739: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:40.778: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:42.819: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:44.859: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:46.899: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:48.938: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:50.977: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:53.018: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:55.057: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:57.097: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:43:59.136: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:01.174: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:03.213: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:05.253: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:07.292: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:09.330: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:11.369: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:13.408: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:15.447: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:17.487: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:19.526: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:21.567: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:23.607: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:25.646: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:27.685: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:29.725: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:31.765: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:33.806: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:35.845: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:37.886: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:39.926: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:41.965: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:44.007: INFO: PersistentVolumeClaim pvc-44gjz found but phase is Pending instead of Bound. Jan 17 21:44:46.008: INFO: Unexpected error: <*errors.errorString | 0xc0000f7ca0>: { s: "PersistentVolumeClaims [pvc-44gjz] not all in phase Bound within 5m0s", } Jan 17 21:44:46.009: FAIL: PersistentVolumeClaims [pvc-44gjz] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc0005bf710, {0x26fb380?, 0xc000a0e340}, 0xc000a6c840, {0x7ff9f557a358, 0xc0004d4f30}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicMultipleVolumes(0xc0005bf8a8, {0x26fb380, 0xc000a0e340}, 0x0?, {0x7ff9f557a358, 0xc0004d4f30}, {0x220ec17?, 0xc0009d68d8?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:80 +0x2a5 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedPodWithMultiplePVsTest).Run(0xc0005bfc00, {0x26fb380, 0xc000a0e340}, 0x0?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_pod_with_multiple_pv.go:38 +0x133 sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func19() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:802 +0x7ac �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 21:44:46.009�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-3847" for this suite. �[38;5;243m01/17/23 21:44:46.01�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\screate\sa\spod\swith\svolume\smount\ssubpath\s\[disk\.csi\.azure\.com\]\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000a2bc80, {0x26fb380?, 0xc000a0e340}, 0xc000206160, {0x7ff9f557a358, 0xc0004d4f30}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumesWithSubpath(0xc000b05e20, {0x26fb380, 0xc000a0e340}, 0xc000409801?, {0x7ff9f557a358, 0xc0004d4f30}, 0x7ff9f44a5688?, {0x220ec17?, 0x7ffa1fb5df18?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:100 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedVolumeSubpathTester).Run(0xc000a2bf08, {0x26fb380, 0xc000a0e340}, 0x11?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_volume_subpath_tester.go:38 +0x13c sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func3() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:198 +0x3c8 There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc000d51f90?, 0xc000d29f08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc0006f9b30?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc000d51f90?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T20:44:10.903545536Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T20:44:10.904882299Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T20:44:11.028997938Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T20:44:11.101981052Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T20:44:11.603713639Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T20:44:11.603836869Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T20:44:11.642369626Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T20:44:11.642520011Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T20:44:11.683188997Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T20:49:13.120341347Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T20:49:13.121010197Z &{Text:Destroying namespace "azuredisk-8182" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 20:44:10.903�[0m Jan 17 20:44:10.903: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 20:44:10.904�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 20:44:11.028�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 20:44:11.101�[0m Jan 17 20:44:11.602: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 20:44:11.603�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 20:44:11.603�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 20:44:11.642�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 20:44:11.642�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 20:44:11.683�[0m Jan 17 20:44:11.683: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-gh5hb] to have phase Bound Jan 17 20:44:11.720: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:13.782: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:15.821: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:17.860: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:19.900: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:21.939: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:23.979: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:26.021: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:28.060: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:30.100: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:32.138: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:34.178: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:36.217: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:38.256: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:40.295: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:42.335: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:44.373: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:46.413: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:48.452: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:50.492: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:52.531: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:54.570: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:56.608: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:44:58.647: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:00.686: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:02.725: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:04.765: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:06.804: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:08.843: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:10.883: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:12.923: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:14.964: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:20.610: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:22.651: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:24.692: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:26.733: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:28.774: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:30.813: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:32.853: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:34.893: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:36.933: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:38.973: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:41.012: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:43.052: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:45.091: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:47.131: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:49.171: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:51.211: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:53.251: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:55.293: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:57.337: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:45:59.376: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:01.416: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:03.456: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:05.495: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:07.536: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:09.576: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:11.616: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:13.654: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:15.695: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:17.735: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:19.773: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:21.813: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:23.852: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:25.893: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:27.932: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:29.973: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:32.012: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:34.053: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:36.093: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:38.132: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:40.170: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:42.209: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:44.248: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:46.287: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:48.327: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:50.367: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:52.406: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:54.446: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:56.487: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:46:58.529: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:00.569: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:02.607: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:04.649: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:06.690: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:08.729: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:10.769: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:12.808: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:14.847: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:16.886: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:18.925: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:20.963: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:23.003: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:25.042: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:27.082: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:29.121: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:31.160: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:33.201: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:35.240: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:37.282: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:39.322: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:41.362: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:43.402: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:45.442: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:47.485: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:49.525: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:51.564: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:53.604: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:55.644: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:57.684: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:47:59.723: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:01.764: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:03.803: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:05.843: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:07.884: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:09.924: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:11.964: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:14.003: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:16.050: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:18.089: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:20.129: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:22.168: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:24.206: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:26.245: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:28.286: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:30.326: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:32.365: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:34.404: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:36.443: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:38.482: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:40.522: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:42.564: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:44.602: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:46.641: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:48.681: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:50.721: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:52.759: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:54.799: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:56.838: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:48:58.878: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:49:00.917: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:49:02.957: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:49:04.997: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:49:07.038: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:49:09.077: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:49:11.116: INFO: PersistentVolumeClaim pvc-gh5hb found but phase is Pending instead of Bound. Jan 17 20:49:13.118: INFO: Unexpected error: <*errors.errorString | 0xc0000c9040>: { s: "PersistentVolumeClaims [pvc-gh5hb] not all in phase Bound within 5m0s", } Jan 17 20:49:13.119: FAIL: PersistentVolumeClaims [pvc-gh5hb] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000a2bc80, {0x26fb380?, 0xc000a0e340}, 0xc000206160, {0x7ff9f557a358, 0xc0004d4f30}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumesWithSubpath(0xc000b05e20, {0x26fb380, 0xc000a0e340}, 0xc000409801?, {0x7ff9f557a358, 0xc0004d4f30}, 0x7ff9f44a5688?, {0x220ec17?, 0x7ffa1fb5df18?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:100 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedVolumeSubpathTester).Run(0xc000a2bf08, {0x26fb380, 0xc000a0e340}, 0x11?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_volume_subpath_tester.go:38 +0x13c sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func3() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:198 +0x3c8 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 20:49:13.12�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-8182" for this suite. �[38;5;243m01/17/23 20:49:13.121�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\screate\sa\spod\,\swrite\sand\sread\sto\sit\,\stake\sa\svolume\ssnapshot\,\sand\screate\sanother\spod\sfrom\sthe\ssnapshot\s\[disk\.csi\.azure\.com\]\s\[csi\-azuredisk\-scheduler\-extender\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000b9f570, {0x26fb380?, 0xc000a0e340}, 0xc000e93ce0, {0x7ff9f557a358, 0xc0004d4f30}, 0x3e?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedVolumeSnapshotTest).Run(0xc000b9fd18, {0x26fb380, 0xc000a0e340}, {0x26e5480, 0xc0011ca460}, 0xc000e93ce0, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_volume_snapshot_tester.go:59 +0x15d sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func17() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:724 +0x796 There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc000026860?, 0x4?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc000da0f18?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc000026860?, 0x1?}, {0x38b4c50?, 0xc00074a901?, 0x1?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T21:29:38.077943895Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T21:29:38.079640691Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T21:29:38.197658386Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T21:29:38.270667987Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T21:29:38.722864952Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T21:29:38.723027388Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T21:29:38.76209372Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T21:29:38.762233905Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T21:29:38.805679652Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T21:34:40.657113953Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T21:34:40.657531368Z &{Text:Destroying namespace "azuredisk-14" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 21:29:38.077�[0m Jan 17 21:29:38.078: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 21:29:38.079�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 21:29:38.197�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 21:29:38.27�[0m Jan 17 21:29:38.721: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 21:29:38.722�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 21:29:38.723�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 21:29:38.762�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 21:29:38.762�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 21:29:38.805�[0m Jan 17 21:29:38.805: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-z5mpf] to have phase Bound Jan 17 21:29:38.845: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:29:40.886: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:29:42.926: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:29:44.964: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:29:47.006: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:29:49.048: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:29:51.087: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:29:53.127: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:29:55.166: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:29:57.204: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:29:59.242: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:01.281: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:03.321: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:05.359: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:07.398: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:09.436: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:11.474: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:13.513: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:15.552: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:17.590: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:19.630: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:21.670: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:23.708: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:25.747: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:27.786: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:29.826: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:31.866: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:33.906: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:35.946: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:37.984: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:40.023: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:42.063: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:44.103: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:46.143: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:48.181: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:50.223: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:52.261: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:54.300: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:56.339: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:30:58.379: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:00.420: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:02.460: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:04.499: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:06.538: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:08.578: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:10.619: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:12.658: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:14.696: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:16.735: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:18.774: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:20.814: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:22.854: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:24.894: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:26.933: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:28.972: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:31.011: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:33.050: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:35.089: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:37.128: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:39.169: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:41.209: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:43.248: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:45.289: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:47.329: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:49.368: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:51.406: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:53.447: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:55.488: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:57.528: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:31:59.569: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:01.608: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:03.647: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:05.687: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:07.730: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:09.769: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:11.808: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:13.846: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:15.886: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:17.926: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:19.964: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:22.003: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:24.043: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:26.082: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:28.122: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:30.162: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:32.200: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:34.240: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:36.280: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:38.320: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:40.360: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:42.400: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:44.439: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:46.479: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:48.517: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:50.556: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:52.595: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:54.635: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:56.674: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:32:58.715: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:00.756: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:02.795: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:04.834: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:06.874: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:08.914: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:10.953: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:12.993: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:15.032: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:17.071: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:19.111: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:21.151: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:23.190: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:25.230: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:27.270: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:29.310: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:31.350: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:33.389: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:35.430: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:37.469: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:39.509: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:41.548: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:43.586: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:45.626: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:47.665: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:49.704: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:51.743: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:53.781: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:55.823: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:57.862: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:33:59.902: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:01.941: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:03.982: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:06.022: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:08.062: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:10.101: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:12.140: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:14.185: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:16.224: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:18.262: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:20.302: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:22.341: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:24.379: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:26.419: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:28.458: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:30.498: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:32.536: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:34.575: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:36.615: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:38.654: INFO: PersistentVolumeClaim pvc-z5mpf found but phase is Pending instead of Bound. Jan 17 21:34:40.655: INFO: Unexpected error: <*errors.errorString | 0xc000d51980>: { s: "PersistentVolumeClaims [pvc-z5mpf] not all in phase Bound within 5m0s", } Jan 17 21:34:40.656: FAIL: PersistentVolumeClaims [pvc-z5mpf] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000b9f570, {0x26fb380?, 0xc000a0e340}, 0xc000e93ce0, {0x7ff9f557a358, 0xc0004d4f30}, 0x3e?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedVolumeSnapshotTest).Run(0xc000b9fd18, {0x26fb380, 0xc000a0e340}, {0x26e5480, 0xc0011ca460}, 0xc000e93ce0, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_volume_snapshot_tester.go:59 +0x15d sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func17() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:724 +0x796 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 21:34:40.657�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-14" for this suite. �[38;5;243m01/17/23 21:34:40.657�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\screate\sa\spod\,\swrite\sto\sits\spv\,\stake\sa\svolume\ssnapshot\,\soverwrite\sdata\sin\soriginal\spv\,\screate\sanother\spod\sfrom\sthe\ssnapshot\,\sand\sread\sunaltered\soriginal\sdata\sfrom\soriginal\spv\[disk\.csi\.azure\.com\]\s\[csi\-azuredisk\-scheduler\-extender\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000ceb510, {0x26fb380?, 0xc000a0fa00}, 0xc000bede40, {0x7ff9f557a358, 0xc0004d4f30}, 0x3e?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedVolumeSnapshotTest).Run(0xc000cebd18, {0x26fb380, 0xc000a0fa00}, {0x26e5480, 0xc000d3cb40}, 0xc000bede40, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_volume_snapshot_tester.go:59 +0x15d sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func18() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:773 +0x8f6 There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc0004d4230?, 0xc000dadf08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc00053e030?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc0004d4230?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T21:34:40.699979699Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T21:34:40.702190245Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T21:34:40.816476336Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T21:34:40.892738452Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T21:34:41.361337886Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T21:34:41.361482071Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T21:34:41.400412665Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T21:34:41.400564914Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T21:34:41.440993649Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T21:39:43.292386646Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T21:39:43.292806606Z &{Text:Destroying namespace "azuredisk-4589" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 21:34:40.699�[0m Jan 17 21:34:40.700: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 21:34:40.702�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 21:34:40.816�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 21:34:40.892�[0m Jan 17 21:34:41.360: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 21:34:41.361�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 21:34:41.361�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 21:34:41.4�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 21:34:41.4�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 21:34:41.44�[0m Jan 17 21:34:41.441: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-f2knt] to have phase Bound Jan 17 21:34:41.478: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:34:43.518: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:34:45.558: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:34:47.597: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:34:49.635: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:34:51.675: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:34:53.716: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:34:55.756: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:34:57.795: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:34:59.834: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:01.873: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:03.912: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:05.950: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:07.989: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:10.028: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:12.068: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:14.106: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:16.145: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:18.183: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:20.223: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:22.262: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:24.300: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:26.342: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:28.382: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:30.424: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:32.463: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:34.505: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:36.545: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:38.586: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:40.625: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:42.664: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:44.707: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:46.748: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:48.786: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:50.825: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:52.864: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:54.902: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:56.942: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:35:58.983: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:01.022: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:03.063: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:05.102: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:07.141: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:09.181: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:11.221: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:13.262: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:15.300: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:17.339: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:19.379: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:21.418: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:23.461: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:25.501: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:27.540: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:29.581: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:31.621: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:33.662: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:35.701: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:37.741: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:39.780: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:41.820: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:43.859: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:45.899: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:47.938: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:49.977: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:52.016: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:54.055: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:56.093: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:36:58.131: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:00.170: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:02.208: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:04.247: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:06.286: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:08.326: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:10.364: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:12.405: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:14.443: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:16.481: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:18.522: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:20.561: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:22.600: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:24.640: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:26.679: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:28.721: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:30.759: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:32.799: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:34.838: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:36.877: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:38.917: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:40.955: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:42.994: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:45.033: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:47.072: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:49.112: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:51.150: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:53.191: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:55.229: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:57.268: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:37:59.308: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:01.346: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:03.387: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:05.426: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:07.464: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:09.504: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:11.545: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:13.583: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:15.622: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:17.662: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:19.701: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:21.739: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:23.777: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:25.817: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:27.857: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:29.896: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:31.935: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:33.977: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:36.016: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:38.054: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:40.095: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:42.137: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:44.177: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:46.217: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:48.257: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:50.299: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:52.339: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:54.381: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:56.421: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:38:58.460: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:00.500: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:02.541: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:04.580: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:06.622: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:08.661: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:10.701: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:12.742: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:14.783: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:16.822: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:18.862: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:20.900: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:22.939: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:24.979: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:27.020: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:29.059: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:31.098: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:33.136: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:35.174: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:37.213: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:39.251: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:41.291: INFO: PersistentVolumeClaim pvc-f2knt found but phase is Pending instead of Bound. Jan 17 21:39:43.291: INFO: Unexpected error: <*errors.errorString | 0xc000784260>: { s: "PersistentVolumeClaims [pvc-f2knt] not all in phase Bound within 5m0s", } Jan 17 21:39:43.291: FAIL: PersistentVolumeClaims [pvc-f2knt] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000ceb510, {0x26fb380?, 0xc000a0fa00}, 0xc000bede40, {0x7ff9f557a358, 0xc0004d4f30}, 0x3e?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedVolumeSnapshotTest).Run(0xc000cebd18, {0x26fb380, 0xc000a0fa00}, {0x26e5480, 0xc000d3cb40}, 0xc000bede40, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_volume_snapshot_tester.go:59 +0x15d sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func18() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:773 +0x8f6 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 21:39:43.292�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-4589" for this suite. �[38;5;243m01/17/23 21:39:43.292�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\screate\sa\svolume\son\sdemand\sand\smount\sit\sas\sreadOnly\sin\sa\spod\s\[kubernetes\.io\/azure\-disk\]\s\[disk\.csi\.azure\.com\]\s\[Windows\]\s\[csi\-azuredisk\-scheduler\-extender\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000bc37c0, {0x26fb380?, 0xc000a0fa00}, 0xc000dbbe40, {0x7ff9f557a358, 0xc0004d4f30}, 0x20?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000bc39c8, {0x26fb380, 0xc000a0fa00}, 0x203000?, {0x7ff9f557a358, 0xc0004d4f30}, 0x1?, {0x220ec17?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedReadOnlyVolumeTest).Run(0xc000bc3cf8, {0x26fb380, 0xc000a0fa00}, 0x7?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_read_only_volume_tester.go:47 +0x151 sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func8() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:375 +0x60c There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc000580580?, 0xc000b48f08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc000703830?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc000580580?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T20:59:20.084942532Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T20:59:20.087772764Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T20:59:20.212515384Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T20:59:20.286373749Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T20:59:20.773140524Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T20:59:20.773295453Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T20:59:20.812936628Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T20:59:20.813137483Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T20:59:20.855405199Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T21:04:22.736893066Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T21:04:22.737497486Z &{Text:Destroying namespace "azuredisk-4551" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 20:59:20.084�[0m Jan 17 20:59:20.085: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 20:59:20.087�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 20:59:20.212�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 20:59:20.286�[0m Jan 17 20:59:20.771: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 20:59:20.773�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 20:59:20.773�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 20:59:20.812�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 20:59:20.813�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 20:59:20.855�[0m Jan 17 20:59:20.855: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-hrp2d] to have phase Bound Jan 17 20:59:20.893: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:22.935: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:24.973: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:27.013: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:29.050: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:31.090: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:33.130: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:35.170: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:37.209: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:39.248: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:41.287: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:43.326: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:45.371: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:47.410: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:49.451: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:51.490: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:53.530: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:55.568: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:57.608: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 20:59:59.646: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:01.686: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:03.725: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:05.766: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:07.808: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:09.847: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:11.886: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:13.925: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:15.964: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:18.004: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:20.043: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:22.082: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:24.122: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:26.160: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:28.198: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:30.237: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:32.276: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:34.314: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:36.353: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:38.393: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:40.433: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:42.472: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:44.513: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:46.553: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:48.592: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:50.636: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:52.674: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:54.714: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:56.753: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:00:58.794: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:00.834: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:02.873: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:04.912: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:06.951: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:08.991: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:11.030: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:13.068: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:15.108: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:17.147: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:19.186: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:21.225: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:23.263: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:25.302: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:27.342: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:29.382: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:31.421: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:33.461: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:35.501: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:37.541: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:39.580: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:41.619: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:43.659: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:45.700: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:47.740: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:49.782: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:51.822: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:53.861: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:55.901: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:57.939: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:01:59.978: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:02.018: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:04.058: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:06.098: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:08.137: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:10.176: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:12.224: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:14.263: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:16.302: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:18.344: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:20.385: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:22.423: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:24.463: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:26.502: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:28.543: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:30.584: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:32.623: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:34.667: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:36.706: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:38.746: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:40.785: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:42.825: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:44.865: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:46.905: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:48.946: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:50.986: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:53.024: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:55.062: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:57.102: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:02:59.140: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:01.180: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:03.218: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:05.256: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:07.295: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:09.343: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:11.382: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:13.420: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:15.460: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:17.501: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:19.539: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:21.579: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:23.619: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:25.658: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:27.697: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:29.737: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:31.777: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:33.817: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:35.857: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:37.896: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:39.935: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:41.974: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:44.014: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:46.054: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:48.096: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:50.134: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:52.175: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:54.216: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:56.255: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:03:58.295: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:00.334: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:02.375: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:04.416: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:06.455: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:08.494: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:10.533: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:12.573: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:14.612: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:16.655: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:18.694: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:20.735: INFO: PersistentVolumeClaim pvc-hrp2d found but phase is Pending instead of Bound. Jan 17 21:04:22.735: INFO: Unexpected error: <*errors.errorString | 0xc000f44dc0>: { s: "PersistentVolumeClaims [pvc-hrp2d] not all in phase Bound within 5m0s", } Jan 17 21:04:22.736: FAIL: PersistentVolumeClaims [pvc-hrp2d] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000bc37c0, {0x26fb380?, 0xc000a0fa00}, 0xc000dbbe40, {0x7ff9f557a358, 0xc0004d4f30}, 0x20?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000bc39c8, {0x26fb380, 0xc000a0fa00}, 0x203000?, {0x7ff9f557a358, 0xc0004d4f30}, 0x1?, {0x220ec17?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedReadOnlyVolumeTest).Run(0xc000bc3cf8, {0x26fb380, 0xc000a0fa00}, 0x7?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_read_only_volume_tester.go:47 +0x151 sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func8() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:375 +0x60c �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 21:04:22.736�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-4551" for this suite. �[38;5;243m01/17/23 21:04:22.737�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\screate\sa\svolume\son\sdemand\sand\sresize\sit\s\[disk\.csi\.azure\.com\]\s\[Windows\]\s\[csi\-azuredisk\-scheduler\-extender\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:805 ------------------------------ This is the Progress Report generated when the timeout occurred: Dynamic Provisioning [single-az] should create a volume on demand and resize it [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender] (Spec Runtime: 2m14.929s) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:805 In [It] (Node Runtime: 2m14.276s) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:805 At [By Step] deploying the statefulset (Step Runtime: 2m14.161s) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_resize_volume_tester.go:60 Spec Goroutine goroutine 7276 [select] k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x26de9d0, 0xc000132000}, 0xc000eba8a0, 0x124f0ea?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/apimachinery/pkg/util/wait.poll({0x26de9d0, 0xc000132000}, 0x68?, 0x124dd85?, 0x10?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x26de9d0, 0xc000132000}, 0x800?, 0xc000a504b8?, 0x40fae7?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/apimachinery/pkg/util/wait.PollImmediate(0xc9?, 0x26c5740?, 0xc000580a60?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).WaitForPodReadyOrFail(0xc000a9d2c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:169 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestStatefulset).Create(0xc000a9d2c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/statefulset.go:120 > sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedResizeVolumeTest).Run(0xc000a51c68, {0x26fb380?, 0xc000a0fa00}, 0xc00078cdc0, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_resize_volume_tester.go:61 | | ginkgo.By("deploying the statefulset") > tStatefulSet.Create() | | ginkgo.By("checking that the pod for statefulset is running") > sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func20() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:843 | test.StorageClassParameters = map[string]string{consts.SkuNameField: "StandardSSD_ZRS", "fsType": "btrfs"} | } > test.Run(cs, ns, schedulerName) | }) | github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc0006f8480, 0xc00021ea80}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/internal/node.go:449 github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 github.com/onsi/ginkgo/v2/internal.(*Suite).runNode /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 ------------------------------ There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc000164050?, 0x40d467?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0x161635f?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc000164050?, 0xc000068cc0?}, {0x38b4c50?, 0xc0011144b0?, 0x232f088?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T21:44:46.051456717Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T21:44:46.052869886Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T21:44:46.167619125Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T21:44:46.241034924Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:258 2023-01-17T21:44:46.704887763Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T21:44:46.779579228Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:287 2023-01-17T21:44:46.818593191Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:303 2023-01-17T21:44:46.818758607Z &{Text:setting up the statefulset Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_resize_volume_tester.go:60 2023-01-17T21:44:46.818961871Z &{Text:deploying the statefulset Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T21:47:00.982165583Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T21:47:00.982635908Z &{Text:Destroying namespace "azuredisk-9587" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 21:44:46.051�[0m Jan 17 21:44:46.051: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 21:44:46.052�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 21:44:46.167�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 21:44:46.241�[0m Jan 17 21:44:46.703: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 21:44:46.704�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 21:44:46.779�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 21:44:46.818�[0m �[1mSTEP:�[0m setting up the statefulset �[38;5;243m01/17/23 21:44:46.818�[0m �[1mSTEP:�[0m deploying the statefulset �[38;5;243m01/17/23 21:44:46.818�[0m I0117 21:44:46.898295 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:44:48.936811 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:44:50.939465 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:44:52.936621 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:44:54.937998 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:44:56.937154 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:44:58.937123 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:00.937310 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:02.944222 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:04.938886 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:06.937802 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:08.937179 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:10.939068 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:12.941764 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:14.938895 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:16.937519 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:18.938015 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:20.937440 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:22.937672 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:24.936377 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:26.938237 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:28.938121 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:30.936699 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:32.937313 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:34.937155 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:36.938134 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:38.939167 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:40.938013 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:42.938941 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:44.938185 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:46.939126 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:48.936865 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:50.936933 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:52.937093 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:54.937695 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:56.938145 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:45:58.938609 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:00.937700 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:02.937121 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:04.937996 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:06.938769 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:08.939117 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:10.937187 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:12.938320 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:14.937086 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:16.937524 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:18.938992 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:20.937845 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:22.939028 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:24.938025 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:26.937985 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:28.937570 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:30.938771 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:32.938643 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:34.936892 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:36.937607 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:38.938111 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:40.937934 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:42.937801 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:44.937068 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:46.939821 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:48.938010 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:50.939053 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:52.938905 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:54.938374 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:56.940299 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:46:58.938781 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready I0117 21:47:00.939019 16300 statefulset.go:175] 0/1 replicas in the StatefulSet are ready �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 21:47:00.982�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-9587" for this suite. �[38;5;243m01/17/23 21:47:00.982�[0m
Find for mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\screate\sa\svolume\son\sdemand\swith\smount\soptions\s\[kubernetes\.io\/azure\-disk\]\s\[disk\.csi\.azure\.com\]\s\[Windows\]\s\[csi\-azuredisk\-scheduler\-extender\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000c37830, {0x26fb380?, 0xc0010f44e0}, 0xc000c69600, {0x7ff9f557a358, 0xc0004d4f30}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000c379d0, {0x26fb380, 0xc0010f44e0}, 0x0?, {0x7ff9f557a358, 0xc0004d4f30}, 0x7ff9f4d0e758?, {0x220ec17?, 0x7ffa1fb5df18?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedCmdVolumeTest).Run(0xc000c37cf8, {0x26fb380, 0xc0010f44e0}, 0x7?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_cmd_volume_tester.go:39 +0x13c sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func2() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:162 +0x9a5 There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc000806a40?, 0xc000daff08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc0005230b0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc000806a40?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T20:39:08.185255195Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T20:39:08.186316726Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T20:39:08.299079505Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T20:39:08.372902049Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T20:39:08.869443294Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T20:39:08.869575007Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T20:39:08.909207814Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T20:39:08.909342282Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T20:39:08.950040074Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T20:44:10.862526061Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T20:44:10.862917149Z &{Text:Destroying namespace "azuredisk-2005" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 20:39:08.185�[0m Jan 17 20:39:08.185: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 20:39:08.186�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 20:39:08.299�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 20:39:08.372�[0m Jan 17 20:39:08.867: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 20:39:08.869�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 20:39:08.869�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 20:39:08.909�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 20:39:08.909�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 20:39:08.95�[0m Jan 17 20:39:08.950: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-tz74b] to have phase Bound Jan 17 20:39:08.987: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:11.025: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:13.064: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:15.103: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:17.143: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:19.183: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:21.222: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:23.262: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:25.302: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:27.342: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:29.382: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:31.423: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:33.462: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:35.502: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:37.542: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:39.584: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:41.623: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:43.662: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:45.701: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:47.741: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:49.780: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:51.820: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:53.862: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:55.902: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:57.942: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:39:59.981: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:02.020: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:04.061: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:06.106: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:08.146: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:10.185: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:12.224: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:14.264: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:16.335: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:18.376: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:20.416: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:22.457: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:24.496: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:26.537: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:28.577: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:30.615: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:32.654: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:34.693: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:36.735: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:38.779: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:40.823: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:42.866: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:44.905: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:46.944: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:48.983: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:51.022: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:53.062: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:55.101: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:57.139: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:40:59.179: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:01.218: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:03.258: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:05.296: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:07.335: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:09.374: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:11.415: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:13.455: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:15.494: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:17.534: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:19.575: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:21.615: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:23.655: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:25.693: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:27.734: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:29.773: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:31.812: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:33.850: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:35.890: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:37.929: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:39.969: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:42.008: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:44.048: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:46.088: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:48.128: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:50.167: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:52.205: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:54.246: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:56.285: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:41:58.325: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:00.363: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:02.403: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:04.441: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:06.480: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:08.519: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:10.559: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:12.598: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:14.645: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:16.685: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:18.725: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:20.764: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:22.803: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:24.841: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:26.881: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:28.919: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:30.958: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:32.998: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:35.037: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:37.075: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:39.113: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:41.151: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:43.192: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:45.232: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:47.271: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:49.309: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:51.348: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:53.395: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:55.436: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:57.474: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:42:59.513: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:01.552: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:03.592: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:05.631: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:07.670: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:09.711: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:11.750: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:13.789: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:15.829: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:17.882: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:19.920: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:21.960: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:23.998: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:26.036: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:28.076: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:30.114: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:32.152: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:34.191: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:36.229: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:38.267: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:40.306: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:42.345: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:44.385: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:46.424: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:48.463: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:50.503: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:52.543: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:54.585: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:56.623: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:43:58.662: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:44:00.702: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:44:02.740: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:44:04.781: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:44:06.820: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:44:08.861: INFO: PersistentVolumeClaim pvc-tz74b found but phase is Pending instead of Bound. Jan 17 20:44:10.861: INFO: Unexpected error: <*errors.errorString | 0xc0004d5710>: { s: "PersistentVolumeClaims [pvc-tz74b] not all in phase Bound within 5m0s", } Jan 17 20:44:10.861: FAIL: PersistentVolumeClaims [pvc-tz74b] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000c37830, {0x26fb380?, 0xc0010f44e0}, 0xc000c69600, {0x7ff9f557a358, 0xc0004d4f30}, 0x7a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000c379d0, {0x26fb380, 0xc0010f44e0}, 0x0?, {0x7ff9f557a358, 0xc0004d4f30}, 0x7ff9f4d0e758?, {0x220ec17?, 0x7ffa1fb5df18?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedCmdVolumeTest).Run(0xc000c37cf8, {0x26fb380, 0xc0010f44e0}, 0x7?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_cmd_volume_tester.go:39 +0x13c sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func2() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:162 +0x9a5 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 20:44:10.862�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-2005" for this suite. �[38;5;243m01/17/23 20:44:10.862�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\screate\smultiple\sPV\sobjects\,\sbind\sto\sPVCs\sand\sattach\sall\sto\sa\ssingle\spod\s\[kubernetes\.io\/azure\-disk\]\s\[disk\.csi\.azure\.com\]\s\[Windows\]\s\[csi\-azuredisk\-scheduler\-extender\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000b9f818, {0x26fb380?, 0xc000a0fa00}, 0xc000e92dc0, {0x7ff9f557a358, 0xc0004d4f30}, 0x172?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000b9f9b8, {0x26fb380, 0xc000a0fa00}, 0xc000d99f20?, {0x7ff9f557a358, 0xc0004d4f30}, 0x7ff9f6ebe898?, {0x220ec17?, 0x7ffa1fb5da68?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedCmdVolumeTest).Run(0xc000b9fcf8, {0x26fb380, 0xc000a0fa00}, 0x7?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_cmd_volume_tester.go:39 +0x13c sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func15() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:643 +0x626 There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc0005808e0?, 0xc000c4bf08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc0005227b0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc0005808e0?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T21:24:34.763702682Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T21:24:34.765045376Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T21:24:34.879313611Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T21:24:34.952217126Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T21:24:35.399048394Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T21:24:35.399210282Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T21:24:35.437991796Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T21:24:35.438118352Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T21:24:35.480408118Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T21:29:37.339360197Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T21:29:37.339616108Z &{Text:Destroying namespace "azuredisk-8267" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 21:24:34.763�[0m Jan 17 21:24:34.763: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 21:24:34.765�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 21:24:34.879�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 21:24:34.952�[0m Jan 17 21:24:35.397: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 21:24:35.399�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 21:24:35.399�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 21:24:35.437�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 21:24:35.438�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 21:24:35.48�[0m Jan 17 21:24:35.480: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-fcjvm] to have phase Bound Jan 17 21:24:35.517: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:37.557: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:39.596: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:41.637: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:43.676: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:45.717: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:47.756: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:49.794: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:51.833: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:53.873: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:55.911: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:57.949: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:24:59.988: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:02.029: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:04.067: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:06.107: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:08.147: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:10.186: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:12.226: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:14.265: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:16.304: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:18.343: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:20.383: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:22.422: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:24.461: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:26.502: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:28.540: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:30.579: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:32.619: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:34.658: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:36.699: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:38.739: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:40.779: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:42.818: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:44.858: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:46.897: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:48.935: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:50.975: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:53.014: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:55.056: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:57.094: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:25:59.133: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:01.172: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:03.212: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:05.250: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:07.289: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:09.327: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:11.367: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:13.406: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:15.445: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:17.485: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:19.524: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:21.564: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:23.602: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:25.641: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:27.681: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:29.722: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:31.762: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:33.801: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:35.841: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:37.882: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:39.933: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:41.971: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:44.009: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:46.050: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:48.089: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:50.128: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:52.166: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:54.206: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:56.246: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:26:58.285: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:00.324: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:02.362: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:04.401: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:06.440: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:08.479: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:10.517: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:12.569: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:14.607: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:16.647: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:18.687: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:20.726: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:22.766: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:24.805: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:26.843: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:28.884: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:30.925: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:32.964: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:35.004: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:37.044: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:39.083: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:41.121: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:43.162: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:45.201: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:47.238: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:49.278: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:51.318: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:53.358: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:55.397: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:57.437: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:27:59.477: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:01.517: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:03.555: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:05.594: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:07.632: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:09.672: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:11.712: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:13.750: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:15.794: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:17.833: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:19.871: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:21.911: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:23.950: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:25.989: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:28.028: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:30.068: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:32.107: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:34.149: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:36.189: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:38.227: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:40.265: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:42.305: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:44.344: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:46.383: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:48.423: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:50.463: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:52.504: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:54.544: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:56.584: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:28:58.625: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:00.664: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:02.702: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:04.743: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:06.782: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:08.822: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:10.860: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:12.900: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:14.938: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:16.976: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:19.018: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:21.059: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:23.101: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:25.139: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:27.178: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:29.218: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:31.257: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:33.297: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:35.337: INFO: PersistentVolumeClaim pvc-fcjvm found but phase is Pending instead of Bound. Jan 17 21:29:37.338: INFO: Unexpected error: <*errors.errorString | 0xc0004d46d0>: { s: "PersistentVolumeClaims [pvc-fcjvm] not all in phase Bound within 5m0s", } Jan 17 21:29:37.338: FAIL: PersistentVolumeClaims [pvc-fcjvm] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000b9f818, {0x26fb380?, 0xc000a0fa00}, 0xc000e92dc0, {0x7ff9f557a358, 0xc0004d4f30}, 0x172?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000b9f9b8, {0x26fb380, 0xc000a0fa00}, 0xc000d99f20?, {0x7ff9f557a358, 0xc0004d4f30}, 0x7ff9f6ebe898?, {0x220ec17?, 0x7ffa1fb5da68?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedCmdVolumeTest).Run(0xc000b9fcf8, {0x26fb380, 0xc000a0fa00}, 0x7?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_cmd_volume_tester.go:39 +0x13c sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func15() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:643 +0x626 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 21:29:37.339�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-8267" for this suite. �[38;5;243m01/17/23 21:29:37.339�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\screate\smultiple\sPV\sobjects\,\sbind\sto\sPVCs\sand\sattach\sall\sto\sdifferent\spods\son\sthe\ssame\snode\s\[kubernetes\.io\/azure\-disk\]\s\[disk\.csi\.azure\.com\]\s\[Windows\]\s\[csi\-azuredisk\-scheduler\-extender\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000bc35a0, {0x26fb380?, 0xc0010f4820}, 0xc000dba6e0, {0x7ff9f557a358, 0xc0004d4f30}, 0x62?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000bc3750, {0x26fb380, 0xc0010f4820}, 0xc000dba6e0?, {0x7ff9f557a358, 0xc0004d4f30}, 0xc000e5fef0?, {0x220ec17?, 0x20?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedCollocatedPodTest).Run(0xc000bc3ad8, {0x26fb380, 0xc0010f4820}, 0x7?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_collocated_pod_tester.go:41 +0x15f sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func9() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:439 +0xb9b There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc000f454d0?, 0xc000edef08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc0005224b0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc000f454d0?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T21:04:22.778560514Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T21:04:22.78057963Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T21:04:22.897767285Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T21:04:22.971657201Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T21:04:23.455522363Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T21:04:23.455740693Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T21:04:23.494272825Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T21:04:23.494455434Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T21:04:23.536544486Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T21:09:25.36148844Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T21:09:25.361911621Z &{Text:Destroying namespace "azuredisk-4398" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 21:04:22.778�[0m Jan 17 21:04:22.778: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 21:04:22.78�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 21:04:22.897�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 21:04:22.971�[0m Jan 17 21:04:23.453: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 21:04:23.455�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 21:04:23.455�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 21:04:23.494�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 21:04:23.494�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 21:04:23.536�[0m Jan 17 21:04:23.536: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-4m6hz] to have phase Bound Jan 17 21:04:23.574: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:25.613: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:27.652: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:29.692: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:31.731: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:33.773: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:35.812: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:37.850: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:39.888: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:41.928: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:43.966: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:46.005: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:48.045: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:50.083: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:52.128: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:54.166: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:56.205: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:04:58.245: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:00.283: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:02.322: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:04.361: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:06.401: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:08.440: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:10.480: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:12.520: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:14.560: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:16.600: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:18.638: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:20.676: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:22.716: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:24.754: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:26.794: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:28.832: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:30.873: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:32.921: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:34.963: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:37.002: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:39.041: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:41.081: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:43.121: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:45.159: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:47.198: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:49.237: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:51.276: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:53.315: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:55.354: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:57.392: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:05:59.430: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:01.470: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:03.509: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:05.546: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:07.585: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:09.625: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:11.664: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:13.703: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:15.742: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:17.783: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:19.821: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:21.859: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:23.898: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:25.937: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:27.977: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:30.016: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:32.056: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:34.096: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:36.134: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:38.174: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:40.214: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:42.254: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:44.294: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:46.332: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:48.373: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:50.411: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:52.452: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:54.493: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:56.531: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:06:58.573: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:00.611: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:02.650: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:04.687: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:06.728: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:08.767: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:10.806: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:12.845: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:14.885: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:16.924: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:18.963: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:21.004: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:23.043: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:25.083: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:27.123: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:29.161: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:31.200: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:33.238: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:35.276: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:37.315: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:39.355: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:41.394: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:43.433: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:45.472: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:47.513: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:49.555: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:51.594: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:53.633: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:55.671: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:57.709: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:07:59.749: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:01.788: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:03.826: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:05.866: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:07.904: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:09.942: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:11.982: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:14.021: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:16.060: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:18.099: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:20.137: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:22.176: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:24.215: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:26.255: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:28.294: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:30.333: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:32.374: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:34.413: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:36.453: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:38.493: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:40.532: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:42.571: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:44.609: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:46.648: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:48.686: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:50.725: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:52.765: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:54.804: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:56.844: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:08:58.882: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:00.922: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:02.961: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:05.001: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:07.041: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:09.081: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:11.120: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:13.159: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:15.200: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:17.239: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:19.279: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:21.319: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:23.359: INFO: PersistentVolumeClaim pvc-4m6hz found but phase is Pending instead of Bound. Jan 17 21:09:25.360: INFO: Unexpected error: <*errors.errorString | 0xc0000f1ef0>: { s: "PersistentVolumeClaims [pvc-4m6hz] not all in phase Bound within 5m0s", } Jan 17 21:09:25.360: FAIL: PersistentVolumeClaims [pvc-4m6hz] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000bc35a0, {0x26fb380?, 0xc0010f4820}, 0xc000dba6e0, {0x7ff9f557a358, 0xc0004d4f30}, 0x62?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*PodDetails).SetupWithDynamicVolumes(0xc000bc3750, {0x26fb380, 0xc0010f4820}, 0xc000dba6e0?, {0x7ff9f557a358, 0xc0004d4f30}, 0xc000e5fef0?, {0x220ec17?, 0x20?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/resource_setup.go:52 +0x1d0 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedCollocatedPodTest).Run(0xc000bc3ad8, {0x26fb380, 0xc0010f4820}, 0x7?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_collocated_pod_tester.go:41 +0x15f sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func9() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:439 +0xb9b �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 21:09:25.361�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-4398" for this suite. �[38;5;243m01/17/23 21:09:25.361�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\sdelete\sPV\swith\sreclaimPolicy\s\"Delete\"\s\[kubernetes\.io\/azure\-disk\]\s\[disk\.csi\.azure\.com\]\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000acf940, {0x26fb380?, 0xc0010f4820}, 0xc000dbab00, {0x7ff9f557a358, 0xc0004d4f30}, 0x8?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedReclaimPolicyTest).Run(0xc000acfce8, {0x26fb380, 0xc0010f4820}, 0x4?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_reclaim_policy_tester.go:44 +0x114 sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func11() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:492 +0x365 There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc0000c8030?, 0xc000d29f08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc00020f780?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc0000c8030?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T21:14:28.091992635Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T21:14:28.094012076Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T21:14:28.208561696Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T21:14:28.282019166Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T21:14:28.739393864Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T21:14:28.739547257Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T21:14:28.778404212Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T21:14:28.778549277Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T21:14:28.819333208Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T21:19:30.667021648Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T21:19:30.667259455Z &{Text:Destroying namespace "azuredisk-8925" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 21:14:28.091�[0m Jan 17 21:14:28.092: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 21:14:28.094�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 21:14:28.208�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 21:14:28.282�[0m Jan 17 21:14:28.737: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 21:14:28.739�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 21:14:28.739�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 21:14:28.778�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 21:14:28.778�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 21:14:28.819�[0m Jan 17 21:14:28.819: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-mlvxq] to have phase Bound Jan 17 21:14:28.857: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:30.897: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:32.939: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:34.979: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:37.020: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:39.061: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:41.100: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:43.138: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:45.178: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:47.218: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:49.258: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:51.300: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:53.339: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:55.378: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:57.417: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:14:59.458: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:01.496: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:03.534: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:05.573: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:07.611: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:09.649: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:11.688: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:13.727: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:15.783: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:17.822: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:19.863: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:21.903: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:23.942: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:25.981: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:28.020: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:30.059: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:32.098: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:34.137: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:36.175: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:38.213: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:40.257: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:42.295: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:44.335: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:46.376: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:48.414: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:50.454: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:52.493: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:54.532: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:56.573: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:15:58.613: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:00.653: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:02.691: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:04.730: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:06.770: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:08.809: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:10.847: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:12.888: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:14.927: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:16.965: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:19.004: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:21.042: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:23.080: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:25.121: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:27.159: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:29.199: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:31.238: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:33.277: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:35.317: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:37.356: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:39.395: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:41.435: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:43.475: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:45.517: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:47.556: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:49.596: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:51.634: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:53.675: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:55.714: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:57.754: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:16:59.793: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:01.833: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:03.872: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:05.910: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:07.948: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:09.986: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:12.026: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:14.066: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:16.106: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:18.145: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:20.184: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:22.225: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:24.264: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:26.303: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:28.340: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:30.380: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:32.419: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:34.459: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:36.499: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:38.538: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:40.576: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:42.615: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:44.653: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:46.691: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:48.730: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:50.769: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:52.808: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:54.846: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:56.886: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:17:58.926: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:00.966: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:03.005: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:05.045: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:07.085: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:09.127: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:11.165: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:13.204: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:15.243: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:17.281: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:19.321: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:21.361: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:23.401: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:25.440: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:27.480: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:29.519: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:31.557: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:33.597: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:35.637: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:37.676: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:39.715: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:41.755: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:43.795: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:45.834: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:47.874: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:49.913: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:51.953: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:53.993: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:56.033: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:18:58.073: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:00.115: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:02.155: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:04.194: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:06.234: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:08.273: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:10.313: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:12.353: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:14.392: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:16.430: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:18.471: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:20.511: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:22.551: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:24.589: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:26.627: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:28.666: INFO: PersistentVolumeClaim pvc-mlvxq found but phase is Pending instead of Bound. Jan 17 21:19:30.666: INFO: Unexpected error: <*errors.errorString | 0xc000f441d0>: { s: "PersistentVolumeClaims [pvc-mlvxq] not all in phase Bound within 5m0s", } Jan 17 21:19:30.666: FAIL: PersistentVolumeClaims [pvc-mlvxq] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000acf940, {0x26fb380?, 0xc0010f4820}, 0xc000dbab00, {0x7ff9f557a358, 0xc0004d4f30}, 0x8?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedReclaimPolicyTest).Run(0xc000acfce8, {0x26fb380, 0xc0010f4820}, 0x4?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_reclaim_policy_tester.go:44 +0x114 sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func11() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:492 +0x365 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 21:19:30.667�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-8925" for this suite. �[38;5;243m01/17/23 21:19:30.667�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sDynamic\sProvisioning\s\[single\-az\]\sshould\sretain\sPV\swith\sreclaimPolicy\s\"Retain\"\s\[disk\.csi\.azure\.com\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000b9f940, {0x26fb380?, 0xc0010f49c0}, 0xc00078d760, {0x7ff9f557a358, 0xc0004d4f30}, 0x8?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedReclaimPolicyTest).Run(0xc000b9fce8, {0x26fb380, 0xc0010f49c0}, 0x4?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_reclaim_policy_tester.go:44 +0x114 sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func12() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:515 +0x393 There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e23c0) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc000f44a40?, 0xc0009d4f08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc0007036b0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc000f44a40?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T21:19:30.70903627Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T21:19:30.710983562Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T21:19:30.825906606Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T21:19:30.899885252Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:132 2023-01-17T21:19:31.361503463Z &{Text:setting up the StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/storage_class.go:47 2023-01-17T21:19:31.361623285Z &{Text:creating a StorageClass Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:84 2023-01-17T21:19:31.401055568Z &{Text:setting up the PVC and PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T21:19:31.401190346Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T21:19:31.455127902Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T21:24:33.342465561Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T21:24:33.343139306Z &{Text:Destroying namespace "azuredisk-3426" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 21:19:30.709�[0m Jan 17 21:19:30.709: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 21:19:30.71�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 21:19:30.825�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 21:19:30.899�[0m Jan 17 21:19:31.360: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m setting up the StorageClass �[38;5;243m01/17/23 21:19:31.361�[0m �[1mSTEP:�[0m creating a StorageClass �[38;5;243m01/17/23 21:19:31.361�[0m �[1mSTEP:�[0m setting up the PVC and PV �[38;5;243m01/17/23 21:19:31.401�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 21:19:31.401�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 21:19:31.455�[0m Jan 17 21:19:31.455: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-bkrbg] to have phase Bound Jan 17 21:19:31.493: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:33.533: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:35.573: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:37.614: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:39.652: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:41.691: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:43.730: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:45.770: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:47.808: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:49.848: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:51.888: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:53.927: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:55.967: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:19:58.007: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:00.048: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:02.086: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:04.125: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:06.164: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:08.205: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:10.243: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:12.281: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:14.320: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:16.358: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:18.396: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:20.436: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:22.475: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:24.516: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:26.555: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:28.596: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:30.635: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:32.674: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:34.715: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:36.755: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:38.794: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:40.831: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:42.869: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:44.908: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:46.947: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:48.986: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:51.025: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:53.063: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:55.102: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:57.141: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:20:59.179: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:01.218: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:03.257: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:05.297: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:07.336: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:09.375: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:11.414: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:13.454: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:15.494: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:17.533: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:19.573: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:21.613: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:23.651: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:25.691: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:27.729: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:29.768: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:31.809: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:33.850: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:35.891: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:37.931: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:39.972: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:42.012: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:44.052: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:46.091: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:48.130: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:50.168: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:52.208: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:54.246: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:56.285: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:21:58.325: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:00.364: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:02.403: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:04.442: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:06.483: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:08.544: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:10.583: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:12.623: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:14.662: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:16.700: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:18.741: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:20.779: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:22.818: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:24.857: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:26.897: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:28.937: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:30.977: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:33.018: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:35.057: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:37.097: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:39.136: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:41.175: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:43.215: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:45.254: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:47.294: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:49.333: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:51.374: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:53.414: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:55.453: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:57.492: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:22:59.531: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:01.571: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:03.611: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:05.650: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:07.691: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:09.730: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:11.770: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:13.808: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:15.848: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:17.889: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:19.928: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:21.968: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:24.009: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:26.047: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:28.087: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:30.127: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:32.167: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:34.206: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:36.247: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:38.286: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:40.324: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:42.365: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:44.406: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:46.446: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:48.486: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:50.524: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:52.564: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:54.606: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:56.644: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:23:58.684: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:00.725: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:02.764: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:04.808: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:06.849: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:08.889: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:10.929: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:12.968: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:15.008: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:17.046: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:19.085: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:21.125: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:23.164: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:25.201: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:27.240: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:29.300: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:31.341: INFO: PersistentVolumeClaim pvc-bkrbg found but phase is Pending instead of Bound. Jan 17 21:24:33.341: INFO: Unexpected error: <*errors.errorString | 0xc000d51840>: { s: "PersistentVolumeClaims [pvc-bkrbg] not all in phase Bound within 5m0s", } Jan 17 21:24:33.341: FAIL: PersistentVolumeClaims [pvc-bkrbg] not all in phase Bound within 5m0s Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPersistentVolumeClaim).WaitForBound(_) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:132 +0x19d sigs.k8s.io/azuredisk-csi-driver/test/resources.(*VolumeDetails).SetupDynamicPersistentVolumeClaim(0xc000b9f940, {0x26fb380?, 0xc0010f49c0}, 0xc00078d760, {0x7ff9f557a358, 0xc0004d4f30}, 0x8?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:103 +0x6d4 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*DynamicallyProvisionedReclaimPolicyTest).Run(0xc000b9fce8, {0x26fb380, 0xc0010f49c0}, 0x4?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/dynamically_provisioned_reclaim_policy_tester.go:44 +0x114 sigs.k8s.io/azuredisk-csi-driver/test/e2e.(*dynamicProvisioningTestSuite).defineTests.func12() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:515 +0x393 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 21:24:33.342�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-3426" for this suite. �[38;5;243m01/17/23 21:24:33.343�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sPre\-Provisioned\s\[single\-az\]\sshould\ssucceed\swhen\sreattaching\sa\sdisk\sto\sa\snew\snode\son\sDanglingAttachError\s\[disk\.csi\.azure\.com\]\[csi\-azuredisk\-scheduler\-extender\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pod.go:88 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPod).WaitForSuccess(0x224886a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pod.go:88 +0x5d sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*PreProvisionedDanglingAttachVolumeTest).Run(0xc000755e78, {0x26fb380, 0xc000a0e340}, 0x1?, {0x220ec17?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/pre_provisioned_dangling_attach_volume_tester.go:85 +0x585 sigs.k8s.io/azuredisk-csi-driver/test/e2e.glob..func4.3.3() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:216 +0x4e5 There were additional failures detected after the initial failure: [FAILED] Jan 17 20:38:48.272: delete volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes" error: disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes) already attached to node(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/virtualMachines/1274k8s000), could not be deleted: disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes) already attached to node(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/virtualMachines/1274k8s000), could not be deleted In [AfterEach] at: /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:113 ---------- [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e2780) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc000785c50?, 0xc0009d8f08?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0xc000703230?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc000785c50?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T20:22:44.306632319Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T20:22:44.308155137Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T20:22:44.422022647Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T20:22:44.495387943Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:189 2023-01-17T20:22:47.556441651Z &{Text:Successfully provisioned a shared disk volume: "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:112 2023-01-17T20:22:47.556729675Z &{Text:setting up the PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pv.go:44 2023-01-17T20:22:47.556877913Z &{Text:creating a PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:120 2023-01-17T20:22:47.597197432Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T20:22:47.59739917Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T20:22:47.638806103Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:134 2023-01-17T20:22:47.676098074Z &{Text:checking the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:98 2023-01-17T20:22:47.713723158Z &{Text:validating provisioned PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:111 2023-01-17T20:22:47.752170511Z &{Text:checking the PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/pre_provisioned_dangling_attach_volume_tester.go:59 2023-01-17T20:22:47.790711397Z &{Text:attaching disk to node#0 Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/pre_provisioned_dangling_attach_volume_tester.go:80 2023-01-17T20:23:05.182673643Z &{Text:deploying the pod Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/pre_provisioned_dangling_attach_volume_tester.go:83 2023-01-17T20:23:05.238913352Z &{Text:checking that the pod's command exits with no error Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/pod/delete.go:41 2023-01-17T20:38:05.435202087Z &{Text:Deleting pod azuredisk-volume-tester-rrv88 in namespace azuredisk-7369 Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:187 2023-01-17T20:38:47.673688887Z &{Text:deleting PV "azuredisk-7369-disk.csi.azure.com-preprovisioned-pv-hd2dr" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:190 2023-01-17T20:38:47.714301799Z &{Text:waiting for claim's PV "azuredisk-7369-disk.csi.azure.com-preprovisioned-pv-hd2dr" to be deleted Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T20:38:48.273273419Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T20:38:48.273541273Z &{Text:Destroying namespace "azuredisk-7369" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 20:22:44.306�[0m Jan 17 20:22:44.306: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 20:22:44.308�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 20:22:44.422�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 20:22:44.495�[0m I0117 20:22:44.568875 16300 azuredisk_driver.go:52] Using azure disk driver: disk.csi.azure.com �[1mSTEP:�[0m Successfully provisioned a shared disk volume: "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes" �[38;5;243m01/17/23 20:22:47.556�[0m �[1mSTEP:�[0m setting up the PV �[38;5;243m01/17/23 20:22:47.556�[0m �[1mSTEP:�[0m creating a PV �[38;5;243m01/17/23 20:22:47.556�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 20:22:47.597�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 20:22:47.597�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 20:22:47.638�[0m Jan 17 20:22:47.638: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-w4qb5] to have phase Bound Jan 17 20:22:47.676: INFO: PersistentVolumeClaim pvc-w4qb5 found and phase=Bound (37.052917ms) �[1mSTEP:�[0m checking the PVC �[38;5;243m01/17/23 20:22:47.676�[0m �[1mSTEP:�[0m validating provisioned PV �[38;5;243m01/17/23 20:22:47.713�[0m �[1mSTEP:�[0m checking the PV �[38;5;243m01/17/23 20:22:47.752�[0m �[1mSTEP:�[0m attaching disk to node#0 �[38;5;243m01/17/23 20:22:47.79�[0m �[1mSTEP:�[0m deploying the pod �[38;5;243m01/17/23 20:23:05.182�[0m �[1mSTEP:�[0m checking that the pod's command exits with no error �[38;5;243m01/17/23 20:23:05.238�[0m Jan 17 20:23:05.239: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-rrv88" in namespace "azuredisk-7369" to be "Succeeded or Failed" Jan 17 20:23:05.277: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 38.227824ms Jan 17 20:23:07.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2.078402074s Jan 17 20:23:09.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4.077988805s Jan 17 20:23:11.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6.078415124s Jan 17 20:23:13.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8.07876351s Jan 17 20:23:15.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10.077161296s Jan 17 20:23:17.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12.079188124s Jan 17 20:23:19.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14.077424586s Jan 17 20:23:21.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 16.077312187s Jan 17 20:23:23.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 18.078080417s Jan 17 20:23:25.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 20.077858789s Jan 17 20:23:27.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 22.078107062s Jan 17 20:23:29.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 24.079663449s Jan 17 20:23:31.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 26.078152759s Jan 17 20:23:33.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 28.078645665s Jan 17 20:23:35.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 30.080417027s Jan 17 20:23:37.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 32.080409562s Jan 17 20:23:39.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 34.078145554s Jan 17 20:23:41.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 36.076986143s Jan 17 20:23:43.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 38.078086558s Jan 17 20:23:45.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 40.07877878s Jan 17 20:23:47.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 42.079074534s Jan 17 20:23:49.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 44.078655363s Jan 17 20:23:51.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 46.078761922s Jan 17 20:23:53.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 48.079254781s Jan 17 20:23:55.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 50.079462665s Jan 17 20:23:57.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 52.079076423s Jan 17 20:23:59.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 54.07956857s Jan 17 20:24:01.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 56.078682323s Jan 17 20:24:03.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 58.077383667s Jan 17 20:24:05.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.077630744s Jan 17 20:24:07.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.079701786s Jan 17 20:24:09.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.078935661s Jan 17 20:24:11.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.077662005s Jan 17 20:24:13.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.078069241s Jan 17 20:24:15.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.07677161s Jan 17 20:24:17.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.077949572s Jan 17 20:24:19.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.077355731s Jan 17 20:24:21.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.077011397s Jan 17 20:24:23.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.077038864s Jan 17 20:24:25.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.078789448s Jan 17 20:24:27.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.078318793s Jan 17 20:24:29.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.079934019s Jan 17 20:24:31.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.078520744s Jan 17 20:24:33.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.076713988s Jan 17 20:24:35.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.078974033s Jan 17 20:24:37.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.078068108s Jan 17 20:24:39.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.077356636s Jan 17 20:24:41.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.077738342s Jan 17 20:24:43.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.076888639s Jan 17 20:24:45.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.078706445s Jan 17 20:24:47.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.077504493s Jan 17 20:24:49.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.077017796s Jan 17 20:24:51.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.079335344s Jan 17 20:24:53.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.077351833s Jan 17 20:24:55.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.077339679s Jan 17 20:24:57.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.079241505s Jan 17 20:24:59.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.079431508s Jan 17 20:25:01.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.080379756s Jan 17 20:25:03.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.079463479s Jan 17 20:25:05.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.078068572s Jan 17 20:25:07.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.078058601s Jan 17 20:25:09.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.079228138s Jan 17 20:25:11.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.077655774s Jan 17 20:25:13.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.076802886s Jan 17 20:25:15.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.07695309s Jan 17 20:25:17.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.076817717s Jan 17 20:25:19.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.07825682s Jan 17 20:25:21.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.077039256s Jan 17 20:25:23.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.076749398s Jan 17 20:25:25.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.076848243s Jan 17 20:25:27.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.078243652s Jan 17 20:25:29.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.078671135s Jan 17 20:25:31.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.077728313s Jan 17 20:25:33.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.078354347s Jan 17 20:25:35.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.080917192s Jan 17 20:25:37.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.07765966s Jan 17 20:25:39.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.077167138s Jan 17 20:25:41.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.078108783s Jan 17 20:25:43.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.079834489s Jan 17 20:25:45.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.078468661s Jan 17 20:25:47.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.078576931s Jan 17 20:25:49.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.076854552s Jan 17 20:25:51.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.076881201s Jan 17 20:25:53.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.0768543s Jan 17 20:25:55.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.077782098s Jan 17 20:25:57.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.078409248s Jan 17 20:25:59.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.076863699s Jan 17 20:26:01.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.077078573s Jan 17 20:26:03.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.078342882s Jan 17 20:26:05.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.078235579s Jan 17 20:26:07.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.080591248s Jan 17 20:26:09.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.077030517s Jan 17 20:26:11.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.078132033s Jan 17 20:26:13.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.078221201s Jan 17 20:26:15.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.078648875s Jan 17 20:26:17.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.078895369s Jan 17 20:26:19.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.078409143s Jan 17 20:26:21.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.07854382s Jan 17 20:26:23.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.078380456s Jan 17 20:26:25.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.077329357s Jan 17 20:26:27.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.077020176s Jan 17 20:26:29.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.076525117s Jan 17 20:26:31.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.077925948s Jan 17 20:26:33.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.077707061s Jan 17 20:26:35.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.076628992s Jan 17 20:26:37.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.077797508s Jan 17 20:26:39.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.077092184s Jan 17 20:26:41.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.078489741s Jan 17 20:26:43.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.079158868s Jan 17 20:26:45.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.078924231s Jan 17 20:26:47.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.079519103s Jan 17 20:26:49.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.076861362s Jan 17 20:26:51.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.078250657s Jan 17 20:26:53.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.077319807s Jan 17 20:26:55.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.079167874s Jan 17 20:26:57.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.080141119s Jan 17 20:26:59.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.078905077s Jan 17 20:27:01.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.079599263s Jan 17 20:27:03.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.07824356s Jan 17 20:27:05.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.079265143s Jan 17 20:27:07.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.076915552s Jan 17 20:27:09.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.077598674s Jan 17 20:27:11.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.077556076s Jan 17 20:27:13.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.078584134s Jan 17 20:27:15.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.077043253s Jan 17 20:27:17.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.07730315s Jan 17 20:27:19.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.076109826s Jan 17 20:27:21.323: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.084607765s Jan 17 20:27:23.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.077846472s Jan 17 20:27:25.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.077561836s Jan 17 20:27:27.326: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.087891286s Jan 17 20:27:29.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.076666025s Jan 17 20:27:31.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.078022112s Jan 17 20:27:33.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.078106505s Jan 17 20:27:35.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.077198366s Jan 17 20:27:37.322: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.083642033s Jan 17 20:27:39.320: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.081720094s Jan 17 20:27:41.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.079284659s Jan 17 20:27:43.348: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.109525528s Jan 17 20:27:45.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.07612524s Jan 17 20:27:47.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.078008957s Jan 17 20:27:49.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.077708741s Jan 17 20:27:51.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.076727899s Jan 17 20:27:53.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.077513006s Jan 17 20:27:55.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.079092387s Jan 17 20:27:57.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.076020029s Jan 17 20:27:59.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.076530101s Jan 17 20:28:01.329: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.090154862s Jan 17 20:28:03.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.077780097s Jan 17 20:28:05.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.0775154s Jan 17 20:28:07.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.077836492s Jan 17 20:28:09.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.077785664s Jan 17 20:28:11.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.079007728s Jan 17 20:28:13.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.078741735s Jan 17 20:28:15.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.079227533s Jan 17 20:28:17.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.079354971s Jan 17 20:28:19.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.078039095s Jan 17 20:28:21.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.077446819s Jan 17 20:28:23.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.077244842s Jan 17 20:28:25.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.076346911s Jan 17 20:28:27.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.07731838s Jan 17 20:28:29.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.078002602s Jan 17 20:28:31.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.078823868s Jan 17 20:28:33.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.07804876s Jan 17 20:28:35.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.077332078s Jan 17 20:28:37.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.077828634s Jan 17 20:28:39.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m34.079712895s Jan 17 20:28:41.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m36.077028269s Jan 17 20:28:43.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m38.07865694s Jan 17 20:28:45.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m40.07970752s Jan 17 20:28:47.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m42.077463962s Jan 17 20:28:49.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m44.078525668s Jan 17 20:28:51.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m46.078303789s Jan 17 20:28:53.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m48.077824116s Jan 17 20:28:55.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.078894572s Jan 17 20:28:57.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.077992889s Jan 17 20:28:59.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.07926388s Jan 17 20:29:01.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.077740968s Jan 17 20:29:03.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.076758236s Jan 17 20:29:05.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.07708268s Jan 17 20:29:07.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.077345587s Jan 17 20:29:09.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.077864475s Jan 17 20:29:11.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.077999419s Jan 17 20:29:13.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.077185925s Jan 17 20:29:15.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.077274233s Jan 17 20:29:17.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.077092368s Jan 17 20:29:19.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.078737142s Jan 17 20:29:21.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.078709512s Jan 17 20:29:23.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.077491761s Jan 17 20:29:25.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.079415082s Jan 17 20:29:27.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.077566969s Jan 17 20:29:29.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.07892558s Jan 17 20:29:31.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.078328135s Jan 17 20:29:33.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.078873543s Jan 17 20:29:35.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.078570548s Jan 17 20:29:37.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.078432762s Jan 17 20:29:39.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.080180054s Jan 17 20:29:41.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.077244485s Jan 17 20:29:43.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.077123617s Jan 17 20:29:45.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.077554073s Jan 17 20:29:47.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.077164369s Jan 17 20:29:49.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m44.078042643s Jan 17 20:29:51.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m46.079384717s Jan 17 20:29:53.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m48.078970324s Jan 17 20:29:55.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m50.077285349s Jan 17 20:29:57.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m52.078437666s Jan 17 20:29:59.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.07759931s Jan 17 20:30:01.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.079600649s Jan 17 20:30:03.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.077425146s Jan 17 20:30:05.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.077279241s Jan 17 20:30:07.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.078130543s Jan 17 20:30:09.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.078969267s Jan 17 20:30:11.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.076816513s Jan 17 20:30:13.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.077136215s Jan 17 20:30:15.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.08003053s Jan 17 20:30:17.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.076688507s Jan 17 20:30:19.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.078144368s Jan 17 20:30:21.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m16.078644612s Jan 17 20:30:23.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m18.078280001s Jan 17 20:30:25.320: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m20.081140056s Jan 17 20:30:27.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m22.079107338s Jan 17 20:30:29.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m24.07784216s Jan 17 20:30:31.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m26.076925245s Jan 17 20:30:33.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m28.07757213s Jan 17 20:30:35.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m30.078047727s Jan 17 20:30:37.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m32.077015828s Jan 17 20:30:39.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m34.078141349s Jan 17 20:30:41.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m36.076971845s Jan 17 20:30:43.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m38.0779729s Jan 17 20:30:45.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m40.076789247s Jan 17 20:30:47.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m42.077880464s Jan 17 20:30:49.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m44.078597108s Jan 17 20:30:51.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m46.076780825s Jan 17 20:30:53.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.077171003s Jan 17 20:30:55.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.076723935s Jan 17 20:30:57.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.0766333s Jan 17 20:30:59.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.079187376s Jan 17 20:31:01.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.076277501s Jan 17 20:31:03.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.076358213s Jan 17 20:31:05.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.077196215s Jan 17 20:31:07.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m2.080371286s Jan 17 20:31:09.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m4.076417695s Jan 17 20:31:11.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m6.077454789s Jan 17 20:31:13.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m8.077005116s Jan 17 20:31:15.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m10.080120242s Jan 17 20:31:17.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m12.077835293s Jan 17 20:31:19.320: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m14.081295324s Jan 17 20:31:21.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m16.077662862s Jan 17 20:31:23.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m18.077024891s Jan 17 20:31:25.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m20.077998137s Jan 17 20:31:27.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m22.079252986s Jan 17 20:31:29.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m24.079165513s Jan 17 20:31:31.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m26.077018902s Jan 17 20:31:33.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m28.079777683s Jan 17 20:31:35.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m30.077382054s Jan 17 20:31:37.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.078900494s Jan 17 20:31:39.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.07855969s Jan 17 20:31:41.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.077927594s Jan 17 20:31:43.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.078949206s Jan 17 20:31:45.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.078565199s Jan 17 20:31:47.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.079478484s Jan 17 20:31:49.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.080683943s Jan 17 20:31:51.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m46.078859379s Jan 17 20:31:53.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m48.078461131s Jan 17 20:31:55.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m50.080480843s Jan 17 20:31:57.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m52.077584626s Jan 17 20:31:59.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m54.076841308s Jan 17 20:32:01.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m56.07669667s Jan 17 20:32:03.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 8m58.077943626s Jan 17 20:32:05.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m0.078388693s Jan 17 20:32:07.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m2.076721902s Jan 17 20:32:09.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m4.077138734s Jan 17 20:32:11.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m6.076936233s Jan 17 20:32:13.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m8.0780934s Jan 17 20:32:15.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m10.076803466s Jan 17 20:32:17.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m12.077422317s Jan 17 20:32:19.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m14.080841732s Jan 17 20:32:21.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m16.078346947s Jan 17 20:32:23.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m18.07744374s Jan 17 20:32:25.320: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m20.081078379s Jan 17 20:32:27.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m22.079564851s Jan 17 20:32:29.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m24.077891963s Jan 17 20:32:31.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m26.07723405s Jan 17 20:32:33.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m28.079355384s Jan 17 20:32:35.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m30.078926638s Jan 17 20:32:37.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m32.077941846s Jan 17 20:32:39.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m34.077173306s Jan 17 20:32:41.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m36.076750291s Jan 17 20:32:43.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m38.076809828s Jan 17 20:32:45.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m40.076609682s Jan 17 20:32:47.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m42.078481115s Jan 17 20:32:49.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m44.078131227s Jan 17 20:32:51.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m46.080218085s Jan 17 20:32:53.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m48.07709779s Jan 17 20:32:55.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m50.077088738s Jan 17 20:32:57.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m52.077012155s Jan 17 20:32:59.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m54.077977443s Jan 17 20:33:01.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m56.079648387s Jan 17 20:33:03.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 9m58.077923046s Jan 17 20:33:05.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m0.077314274s Jan 17 20:33:07.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m2.07693823s Jan 17 20:33:09.331: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m4.092638872s Jan 17 20:33:11.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m6.080107161s Jan 17 20:33:13.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m8.077146945s Jan 17 20:33:15.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m10.077861004s Jan 17 20:33:17.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m12.077692653s Jan 17 20:33:19.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m14.078163994s Jan 17 20:33:21.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m16.077078738s Jan 17 20:33:23.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m18.076879352s Jan 17 20:33:25.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m20.077144991s Jan 17 20:33:27.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m22.07679573s Jan 17 20:33:29.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m24.078009519s Jan 17 20:33:31.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m26.078775498s Jan 17 20:33:33.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m28.078650287s Jan 17 20:33:35.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m30.078264081s Jan 17 20:33:37.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m32.078021336s Jan 17 20:33:39.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m34.078169946s Jan 17 20:33:41.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m36.078202281s Jan 17 20:33:43.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m38.077195935s Jan 17 20:33:45.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m40.077210853s Jan 17 20:33:47.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m42.076945563s Jan 17 20:33:49.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m44.077852701s Jan 17 20:33:51.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m46.079249996s Jan 17 20:33:53.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m48.078856707s Jan 17 20:33:55.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m50.079030778s Jan 17 20:33:57.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m52.079290683s Jan 17 20:33:59.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m54.078968201s Jan 17 20:34:01.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m56.077735477s Jan 17 20:34:03.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 10m58.079061798s Jan 17 20:34:05.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m0.076926116s Jan 17 20:34:07.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m2.080587108s Jan 17 20:34:09.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m4.078186386s Jan 17 20:34:11.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m6.07747986s Jan 17 20:34:13.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m8.077329547s Jan 17 20:34:15.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m10.079084355s Jan 17 20:34:17.326: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m12.087312981s Jan 17 20:34:19.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m14.079602243s Jan 17 20:34:21.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m16.077209353s Jan 17 20:34:23.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m18.076709523s Jan 17 20:34:25.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m20.076889718s Jan 17 20:34:27.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m22.077922168s Jan 17 20:34:29.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m24.076768682s Jan 17 20:34:31.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m26.077789911s Jan 17 20:34:33.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m28.079711914s Jan 17 20:34:35.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m30.07751151s Jan 17 20:34:37.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m32.077476962s Jan 17 20:34:39.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m34.077302178s Jan 17 20:34:41.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m36.078161081s Jan 17 20:34:43.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m38.077929346s Jan 17 20:34:45.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m40.076677935s Jan 17 20:34:47.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m42.077172322s Jan 17 20:34:49.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m44.078063408s Jan 17 20:34:51.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m46.077271841s Jan 17 20:34:53.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m48.07893252s Jan 17 20:34:55.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m50.078246098s Jan 17 20:34:57.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m52.07696698s Jan 17 20:34:59.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m54.077231849s Jan 17 20:35:01.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m56.076851276s Jan 17 20:35:03.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 11m58.078449826s Jan 17 20:35:05.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m0.077798755s Jan 17 20:35:07.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m2.07679398s Jan 17 20:35:09.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m4.078354032s Jan 17 20:35:11.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m6.077156153s Jan 17 20:35:13.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m8.079901698s Jan 17 20:35:15.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m10.078192091s Jan 17 20:35:17.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m12.07774165s Jan 17 20:35:19.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m14.078406248s Jan 17 20:35:21.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m16.078259175s Jan 17 20:35:23.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m18.077720568s Jan 17 20:35:25.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m20.078346206s Jan 17 20:35:27.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m22.077143868s Jan 17 20:35:29.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m24.077678807s Jan 17 20:35:31.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m26.078020811s Jan 17 20:35:33.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m28.078085774s Jan 17 20:35:35.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m30.076615115s Jan 17 20:35:37.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m32.077134778s Jan 17 20:35:39.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m34.076665841s Jan 17 20:35:41.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m36.077375315s Jan 17 20:35:43.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m38.079303062s Jan 17 20:35:45.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m40.078047007s Jan 17 20:35:47.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m42.076528883s Jan 17 20:35:49.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m44.077121742s Jan 17 20:35:51.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m46.076551913s Jan 17 20:35:53.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m48.076628516s Jan 17 20:35:55.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m50.077541032s Jan 17 20:35:57.321: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m52.082092777s Jan 17 20:35:59.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m54.076958096s Jan 17 20:36:01.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m56.077578585s Jan 17 20:36:03.323: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 12m58.084527377s Jan 17 20:36:05.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m0.07727915s Jan 17 20:36:07.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m2.079513767s Jan 17 20:36:09.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m4.076953036s Jan 17 20:36:11.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m6.078156297s Jan 17 20:36:13.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m8.077995497s Jan 17 20:36:15.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m10.076795531s Jan 17 20:36:17.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m12.077018483s Jan 17 20:36:19.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m14.078091415s Jan 17 20:36:21.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m16.079120762s Jan 17 20:36:23.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m18.076741928s Jan 17 20:36:25.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m20.078016906s Jan 17 20:36:27.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m22.076313592s Jan 17 20:36:29.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m24.077864593s Jan 17 20:36:31.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m26.07907214s Jan 17 20:36:33.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m28.078393722s Jan 17 20:36:35.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m30.078347873s Jan 17 20:36:37.320: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m32.081118882s Jan 17 20:36:39.325: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m34.086104972s Jan 17 20:36:41.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m36.077677141s Jan 17 20:36:43.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m38.078243859s Jan 17 20:36:45.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m40.078178084s Jan 17 20:36:47.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m42.078573024s Jan 17 20:36:49.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m44.079973319s Jan 17 20:36:51.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m46.079539086s Jan 17 20:36:53.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m48.077227991s Jan 17 20:36:55.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m50.079160487s Jan 17 20:36:57.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m52.076598673s Jan 17 20:36:59.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m54.076957321s Jan 17 20:37:01.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m56.078296127s Jan 17 20:37:03.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 13m58.07851512s Jan 17 20:37:05.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m0.076228488s Jan 17 20:37:07.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m2.077373276s Jan 17 20:37:09.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m4.080210606s Jan 17 20:37:11.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m6.079714014s Jan 17 20:37:13.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m8.077590389s Jan 17 20:37:15.321: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m10.082763583s Jan 17 20:37:17.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m12.078485835s Jan 17 20:37:19.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m14.080056869s Jan 17 20:37:21.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m16.079420619s Jan 17 20:37:23.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m18.079584922s Jan 17 20:37:25.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m20.077480683s Jan 17 20:37:27.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m22.077425019s Jan 17 20:37:29.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m24.07705379s Jan 17 20:37:31.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m26.078220134s Jan 17 20:37:33.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m28.078122561s Jan 17 20:37:35.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m30.078425243s Jan 17 20:37:37.320: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m32.081108251s Jan 17 20:37:39.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m34.077945944s Jan 17 20:37:41.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m36.079182811s Jan 17 20:37:43.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m38.078219382s Jan 17 20:37:45.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m40.078371381s Jan 17 20:37:47.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m42.078696658s Jan 17 20:37:49.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m44.078042576s Jan 17 20:37:51.318: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m46.07917859s Jan 17 20:37:53.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m48.077992946s Jan 17 20:37:55.317: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m50.078390634s Jan 17 20:37:57.320: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m52.081363022s Jan 17 20:37:59.319: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m54.080098521s Jan 17 20:38:01.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m56.077404199s Jan 17 20:38:03.316: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 14m58.07756896s Jan 17 20:38:05.315: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.076809591s Jan 17 20:38:05.354: INFO: Pod "azuredisk-volume-tester-rrv88": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.115708976s Jan 17 20:38:05.356: INFO: Unexpected error: <*pod.timeoutError | 0xc000eb1380>: { msg: "timed out while waiting for pod azuredisk-7369/azuredisk-volume-tester-rrv88 to be Succeeded or Failed", observedObjects: [ <*v1.Pod | 0xc001107200>{ TypeMeta: {Kind: "", APIVersion: ""}, ObjectMeta: { Name: "azuredisk-volume-tester-rrv88", GenerateName: "azuredisk-volume-tester-", Namespace: "azuredisk-7369", SelfLink: "", UID: "032aa1b4-1fe0-4614-bc0a-ebe2c94d440d", ResourceVersion: "14073", Generation: 0, CreationTimestamp: { Time: { wall: 0, ext: 63809583785, loc: { name: "Local", zone: [ {name: "UTC", offset: 0, isDST: false}, ], tx: [ { when: -576460752303423488, index: 0, isstd: false, isutc: false, }, ], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: "UTC", offset: 0, isDST: false}, }, }, }, DeletionTimestamp: nil, DeletionGracePeriodSeconds: nil, Labels: nil, Annotations: { "kubernetes.io/psp": "privileged", }, OwnerReferences: nil, Finalizers: nil, ManagedFields: [ { Manager: "e2e.test", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63809583785, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:containers\":{\"k:{\\\"name\\\":\\\"volume-tester\\\"}\":{\".\":{},\"f:args\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{},\"f:volumeMounts\":{\".\":{},\"k:{\\\"mountPath\\\":\\\"/mnt/test-1\\\"}\":{\".\":{},\"f:mountPath\":{},\"f:name\":{}}}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:nodeSelector\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{},\"f:volumes\":{\".\":{},\"k:{\\\"name\\\":\\\"test-volume-1\\\"}\":{\".\":{},\"f:name\":{},\"f:persistentVolumeClaim\":{\".\":{},\"f:claimName\":{}}}}}}", }, Subresource: "", }, { Manager: "kubelet.exe", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63809583785, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}", }, Subresource: "status", }, ], }, Spec: { Volumes: [ { Name: "test-volume-1", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, Secret: nil, NFS: nil, ISCSI: nil, Glusterfs: nil, PersistentVolumeClaim: { ClaimName: "pvc-w4qb5", ReadOnly: false, }, RBD: nil, FlexVolume: nil, Cinder: nil, CephFS: nil, Flocker: nil, DownwardAPI: nil, FC: nil, AzureFile: nil, ConfigMap: nil, VsphereVolume: nil, Quobyte: nil, AzureDisk: nil, PhotonPersistentDisk: nil, Projected: nil, PortworxVolume: nil, ScaleIO: nil, StorageOS: nil, CSI: nil, Ephemeral: nil, }, }, { Name: "kube-api-access-nll7k", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, Secret: n... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output Jan 17 20:38:05.356: FAIL: timed out while waiting for pod azuredisk-7369/azuredisk-volume-tester-rrv88 to be Succeeded or Failed Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPod).WaitForSuccess(0x224886a?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pod.go:88 +0x5d sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*PreProvisionedDanglingAttachVolumeTest).Run(0xc000755e78, {0x26fb380, 0xc000a0e340}, 0x1?, {0x220ec17?, 0x0?}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/pre_provisioned_dangling_attach_volume_tester.go:85 +0x585 sigs.k8s.io/azuredisk-csi-driver/test/e2e.glob..func4.3.3() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:216 +0x4e5 Jan 17 20:38:05.356: INFO: deleting Pod "azuredisk-7369"/"azuredisk-volume-tester-rrv88" Jan 17 20:38:05.435: INFO: Error getting logs for pod azuredisk-volume-tester-rrv88: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-rrv88) �[1mSTEP:�[0m Deleting pod azuredisk-volume-tester-rrv88 in namespace azuredisk-7369 �[38;5;243m01/17/23 20:38:05.435�[0m Jan 17 20:38:05.557: INFO: deleting PVC "azuredisk-7369"/"pvc-w4qb5" Jan 17 20:38:05.557: INFO: Deleting PersistentVolumeClaim "pvc-w4qb5" Jan 17 20:38:05.598: INFO: Waiting up to 5m0s for PersistentVolumeClaim pvc-w4qb5 to be removed Jan 17 20:38:47.673: INFO: Claim "pvc-w4qb5" in namespace "azuredisk-7369" doesn't exist in the system �[1mSTEP:�[0m deleting PV "azuredisk-7369-disk.csi.azure.com-preprovisioned-pv-hd2dr" �[38;5;243m01/17/23 20:38:47.673�[0m Jan 17 20:38:47.673: INFO: Deleting PersistentVolume "azuredisk-7369-disk.csi.azure.com-preprovisioned-pv-hd2dr" �[1mSTEP:�[0m waiting for claim's PV "azuredisk-7369-disk.csi.azure.com-preprovisioned-pv-hd2dr" to be deleted �[38;5;243m01/17/23 20:38:47.714�[0m Jan 17 20:38:47.714: INFO: Waiting up to 10m0s for PersistentVolume azuredisk-7369-disk.csi.azure.com-preprovisioned-pv-hd2dr to get deleted Jan 17 20:38:47.751: INFO: PersistentVolume azuredisk-7369-disk.csi.azure.com-preprovisioned-pv-hd2dr was removed Jan 17 20:38:48.272: INFO: Unexpected error: delete volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes" error: disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes) already attached to node(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/virtualMachines/1274k8s000), could not be deleted: <*errors.errorString | 0xc0003a7d20>: { s: "disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes) already attached to node(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/virtualMachines/1274k8s000), could not be deleted", } Jan 17 20:38:48.272: FAIL: delete volume "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes" error: disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes) already attached to node(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/virtualMachines/1274k8s000), could not be deleted: disk(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes) already attached to node(/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/virtualMachines/1274k8s000), could not be deleted Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/e2e.glob..func4.2() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:113 +0x2ef �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 20:38:48.273�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-7369" for this suite. �[38;5;243m01/17/23 20:38:48.273�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\s\[It\]\sPre\-Provisioned\s\[single\-az\]\sshould\suse\sa\spre\-provisioned\svolume\sand\smount\sit\sas\sreadOnly\sin\sa\spod\s\[disk\.csi\.azure\.com\]\[windows\]\[csi\-azuredisk\-scheduler\-extender\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pod.go:113 sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPod).WaitForFailure(0x2248837?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pod.go:113 +0x77 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*PreProvisionedReadOnlyVolumeTest).Run(0xc000755dc8, {0x26fb380, 0xc000d12d00}, 0x1?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/pre_provisioned_read_only_volume_tester.go:57 +0x205 sigs.k8s.io/azuredisk-csi-driver/test/e2e.glob..func4.3.1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:156 +0x47d There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [DeferCleanup (Each)] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:274 +0x5c k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0002e2780) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x1d61520?, 0xc0004d4230?, 0xc00018c858?}, {0x21d0de2, 0x4}, {0x38b4c50, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x1d61520?, 0xc0004d4230?, 0x0?}, {0x38b4c50?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
Report Entries: By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:198 2023-01-17T20:10:56.545310627Z &{Text:Creating a kubernetes client Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:237 2023-01-17T20:10:56.547481647Z &{Text:Building a namespace api object, basename azuredisk Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:246 2023-01-17T20:10:56.661360728Z &{Text:Waiting for a default service account to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:249 2023-01-17T20:10:56.734755754Z &{Text:Waiting for kube-root-ca.crt to be provisioned in namespace Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:129 2023-01-17T20:11:00.246361774Z &{Text:Successfully provisioned AzureDisk volume: "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/pre-provisioned-read-only" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:112 2023-01-17T20:11:00.246576997Z &{Text:setting up the PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pv.go:44 2023-01-17T20:11:00.246704968Z &{Text:creating a PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/volumes.go:120 2023-01-17T20:11:00.293709933Z &{Text:setting up the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:84 2023-01-17T20:11:00.293932021Z &{Text:creating a PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:130 2023-01-17T20:11:00.339024497Z &{Text:waiting for PVC to be in phase "Bound" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:134 2023-01-17T20:11:00.379145502Z &{Text:checking the PVC Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:98 2023-01-17T20:11:00.417267902Z &{Text:validating provisioned PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:111 2023-01-17T20:11:00.455347702Z &{Text:checking the PV Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/pre_provisioned_read_only_volume_tester.go:53 2023-01-17T20:11:00.455485417Z &{Text:deploying the pod Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/pre_provisioned_read_only_volume_tester.go:56 2023-01-17T20:11:00.496020877Z &{Text:checking that the pod's command exits with an error Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/pod/delete.go:41 2023-01-17T20:21:00.695759772Z &{Text:Deleting pod azuredisk-volume-tester-rphdf in namespace azuredisk-4266 Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:187 2023-01-17T20:22:08.852327268Z &{Text:deleting PV "azuredisk-4266-disk.csi.azure.com-preprovisioned-pv-fcqpc" Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pvc.go:190 2023-01-17T20:22:08.892442679Z &{Text:waiting for claim's PV "azuredisk-4266-disk.csi.azure.com-preprovisioned-pv-fcqpc" to be deleted Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:271 2023-01-17T20:22:09.744251667Z &{Text:dump namespace information after failure Duration:0s} -- By Step /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:334 2023-01-17T20:22:09.744880069Z &{Text:Destroying namespace "azuredisk-4266" for this suite. Duration:0s} �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/17/23 20:10:56.545�[0m Jan 17 20:10:56.545: INFO: >>> kubeConfig: /root/tmp3104127656/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP:�[0m Building a namespace api object, basename azuredisk �[38;5;243m01/17/23 20:10:56.547�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/17/23 20:10:56.661�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/17/23 20:10:56.734�[0m I0117 20:10:56.808114 16300 azuredisk_driver.go:52] Using azure disk driver: disk.csi.azure.com �[1mSTEP:�[0m Successfully provisioned AzureDisk volume: "/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-mj4l0his/providers/Microsoft.Compute/disks/pre-provisioned-read-only" �[38;5;243m01/17/23 20:11:00.246�[0m �[1mSTEP:�[0m setting up the PV �[38;5;243m01/17/23 20:11:00.246�[0m �[1mSTEP:�[0m creating a PV �[38;5;243m01/17/23 20:11:00.246�[0m �[1mSTEP:�[0m setting up the PVC �[38;5;243m01/17/23 20:11:00.293�[0m �[1mSTEP:�[0m creating a PVC �[38;5;243m01/17/23 20:11:00.293�[0m �[1mSTEP:�[0m waiting for PVC to be in phase "Bound" �[38;5;243m01/17/23 20:11:00.339�[0m Jan 17 20:11:00.341: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-jdl6w] to have phase Bound Jan 17 20:11:00.379: INFO: PersistentVolumeClaim pvc-jdl6w found and phase=Bound (37.78587ms) �[1mSTEP:�[0m checking the PVC �[38;5;243m01/17/23 20:11:00.379�[0m �[1mSTEP:�[0m validating provisioned PV �[38;5;243m01/17/23 20:11:00.417�[0m �[1mSTEP:�[0m checking the PV �[38;5;243m01/17/23 20:11:00.455�[0m �[1mSTEP:�[0m deploying the pod �[38;5;243m01/17/23 20:11:00.455�[0m �[1mSTEP:�[0m checking that the pod's command exits with an error �[38;5;243m01/17/23 20:11:00.496�[0m Jan 17 20:11:00.496: INFO: Waiting up to 10m0s for pod "azuredisk-volume-tester-rphdf" in namespace "azuredisk-4266" to be "Error status code" Jan 17 20:11:00.534: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 38.704657ms Jan 17 20:11:02.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.077115717s Jan 17 20:11:04.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4.077976822s Jan 17 20:11:06.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6.077507986s Jan 17 20:11:08.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8.077887623s Jan 17 20:11:10.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 10.079006428s Jan 17 20:11:12.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 12.079806918s Jan 17 20:11:14.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 14.077514559s Jan 17 20:11:16.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 16.079553143s Jan 17 20:11:18.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 18.078943998s Jan 17 20:11:20.578: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 20.082698376s Jan 17 20:11:22.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 22.0770584s Jan 17 20:11:24.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 24.07734166s Jan 17 20:11:26.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 26.077224274s Jan 17 20:11:28.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 28.078827055s Jan 17 20:11:30.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 30.078001082s Jan 17 20:11:32.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 32.078058169s Jan 17 20:11:34.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 34.077516485s Jan 17 20:11:36.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 36.081320814s Jan 17 20:11:38.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 38.079454117s Jan 17 20:11:40.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 40.079606527s Jan 17 20:11:42.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 42.078993418s Jan 17 20:11:44.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 44.078031402s Jan 17 20:11:46.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 46.078338745s Jan 17 20:11:48.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 48.077415899s Jan 17 20:11:50.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 50.079220707s Jan 17 20:11:52.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 52.0771952s Jan 17 20:11:54.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 54.080096644s Jan 17 20:11:56.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 56.078686276s Jan 17 20:11:58.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 58.079514368s Jan 17 20:12:00.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.078468246s Jan 17 20:12:02.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.077849022s Jan 17 20:12:04.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.079594686s Jan 17 20:12:06.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.079566174s Jan 17 20:12:08.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.079648139s Jan 17 20:12:10.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.07958684s Jan 17 20:12:12.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.078668047s Jan 17 20:12:14.586: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.090784112s Jan 17 20:12:16.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.079393458s Jan 17 20:12:18.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.078959754s Jan 17 20:12:20.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.077731264s Jan 17 20:12:22.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.077280817s Jan 17 20:12:24.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.079072799s Jan 17 20:12:26.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.078538743s Jan 17 20:12:28.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.077909629s Jan 17 20:12:30.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.080993628s Jan 17 20:12:32.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.077315946s Jan 17 20:12:34.578: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.082384113s Jan 17 20:12:36.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.077219615s Jan 17 20:12:38.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.077183498s Jan 17 20:12:40.579: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.082920605s Jan 17 20:12:42.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.079573791s Jan 17 20:12:44.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.077445206s Jan 17 20:12:46.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.077521248s Jan 17 20:12:48.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.078714544s Jan 17 20:12:50.578: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.082727114s Jan 17 20:12:52.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.077784294s Jan 17 20:12:54.578: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.082451125s Jan 17 20:12:56.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.080543336s Jan 17 20:12:58.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.078041629s Jan 17 20:13:00.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.077499715s Jan 17 20:13:02.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.077336154s Jan 17 20:13:04.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.07988086s Jan 17 20:13:06.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.077219217s Jan 17 20:13:08.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.07774752s Jan 17 20:13:10.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.077155219s Jan 17 20:13:12.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.081173932s Jan 17 20:13:14.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.077258356s Jan 17 20:13:16.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.077645888s Jan 17 20:13:18.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.077027742s Jan 17 20:13:20.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.078882633s Jan 17 20:13:22.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.079954543s Jan 17 20:13:24.586: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.090658332s Jan 17 20:13:26.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.079034141s Jan 17 20:13:28.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.077420966s Jan 17 20:13:30.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.077752132s Jan 17 20:13:32.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.077839416s Jan 17 20:13:34.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.077308069s Jan 17 20:13:36.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.078907093s Jan 17 20:13:38.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.081247818s Jan 17 20:13:40.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.079017015s Jan 17 20:13:42.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.077571448s Jan 17 20:13:44.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.07904752s Jan 17 20:13:46.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.080554168s Jan 17 20:13:48.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.077773173s Jan 17 20:13:50.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.077233957s Jan 17 20:13:52.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.077782666s Jan 17 20:13:54.582: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.086543078s Jan 17 20:13:56.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.079477692s Jan 17 20:13:58.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.078385362s Jan 17 20:14:00.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.079275829s Jan 17 20:14:02.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.079060047s Jan 17 20:14:04.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.077303825s Jan 17 20:14:06.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.079306984s Jan 17 20:14:08.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.078833628s Jan 17 20:14:10.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.080275703s Jan 17 20:14:12.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.079260461s Jan 17 20:14:14.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.077570934s Jan 17 20:14:16.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.076825948s Jan 17 20:14:18.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.079579758s Jan 17 20:14:20.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.078543723s Jan 17 20:14:22.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.079469792s Jan 17 20:14:24.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.076933641s Jan 17 20:14:26.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.079789239s Jan 17 20:14:28.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.077798109s Jan 17 20:14:30.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.07869002s Jan 17 20:14:32.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.077860728s Jan 17 20:14:34.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.079391924s Jan 17 20:14:36.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.080892304s Jan 17 20:14:38.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.080026705s Jan 17 20:14:40.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.078320201s Jan 17 20:14:42.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.078776068s Jan 17 20:14:44.582: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.086077759s Jan 17 20:14:46.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.079717039s Jan 17 20:14:48.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.078427046s Jan 17 20:14:50.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.079529931s Jan 17 20:14:52.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.079341336s Jan 17 20:14:54.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.077957489s Jan 17 20:14:56.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.080307359s Jan 17 20:14:58.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.078121552s Jan 17 20:15:00.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.077617943s Jan 17 20:15:02.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.077886682s Jan 17 20:15:04.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.078919946s Jan 17 20:15:06.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.08072518s Jan 17 20:15:08.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.079601713s Jan 17 20:15:10.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.079331508s Jan 17 20:15:12.578: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.082390355s Jan 17 20:15:14.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.077169547s Jan 17 20:15:16.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.078422821s Jan 17 20:15:18.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.078305438s Jan 17 20:15:20.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.079037906s Jan 17 20:15:22.598: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.102725279s Jan 17 20:15:24.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.078973035s Jan 17 20:15:26.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.078674016s Jan 17 20:15:28.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.080887042s Jan 17 20:15:30.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.079669552s Jan 17 20:15:32.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.079472124s Jan 17 20:15:34.578: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.082534394s Jan 17 20:15:36.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.081208336s Jan 17 20:15:38.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.078812934s Jan 17 20:15:40.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.078786166s Jan 17 20:15:42.608: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.11203059s Jan 17 20:15:44.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.079132056s Jan 17 20:15:46.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.078453488s Jan 17 20:15:48.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.077595835s Jan 17 20:15:50.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.078545243s Jan 17 20:15:52.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.079448559s Jan 17 20:15:54.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.077968808s Jan 17 20:15:56.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.078697739s Jan 17 20:15:58.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.078943075s Jan 17 20:16:00.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.081661023s Jan 17 20:16:02.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.077503735s Jan 17 20:16:04.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.077882946s Jan 17 20:16:06.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.081040116s Jan 17 20:16:08.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.078651698s Jan 17 20:16:10.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.079302795s Jan 17 20:16:12.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.078401569s Jan 17 20:16:14.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.077614063s Jan 17 20:16:16.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.077794505s Jan 17 20:16:18.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.079312721s Jan 17 20:16:20.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.080582486s Jan 17 20:16:22.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.079010936s Jan 17 20:16:24.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.077687801s Jan 17 20:16:26.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.079636758s Jan 17 20:16:28.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.079632809s Jan 17 20:16:30.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.079098814s Jan 17 20:16:32.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.079846338s Jan 17 20:16:34.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m34.078562417s Jan 17 20:16:36.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m36.079382172s Jan 17 20:16:38.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m38.078981048s Jan 17 20:16:40.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m40.078714672s Jan 17 20:16:42.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m42.079655205s Jan 17 20:16:44.584: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m44.087879982s Jan 17 20:16:46.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m46.079561623s Jan 17 20:16:48.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m48.078079859s Jan 17 20:16:50.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.08081213s Jan 17 20:16:52.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.078346229s Jan 17 20:16:54.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.077278341s Jan 17 20:16:56.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.080142736s Jan 17 20:16:58.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.078055075s Jan 17 20:17:00.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.081003966s Jan 17 20:17:02.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.08103854s Jan 17 20:17:04.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.077445063s Jan 17 20:17:06.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.07971444s Jan 17 20:17:08.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.078228128s Jan 17 20:17:10.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.078367176s Jan 17 20:17:12.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.077796757s Jan 17 20:17:14.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.07995678s Jan 17 20:17:16.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.07688258s Jan 17 20:17:18.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.079831842s Jan 17 20:17:20.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.078431737s Jan 17 20:17:22.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.077826563s Jan 17 20:17:24.587: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.090808882s Jan 17 20:17:26.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.079513472s Jan 17 20:17:28.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.077569799s Jan 17 20:17:30.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.077821267s Jan 17 20:17:32.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.08008728s Jan 17 20:17:34.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.077930788s Jan 17 20:17:36.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.079312613s Jan 17 20:17:38.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.078096459s Jan 17 20:17:40.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.078527328s Jan 17 20:17:42.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.077436007s Jan 17 20:17:44.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m44.079022333s Jan 17 20:17:46.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m46.078274127s Jan 17 20:17:48.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m48.079682709s Jan 17 20:17:50.582: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m50.085917488s Jan 17 20:17:52.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m52.078454227s Jan 17 20:17:54.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.078674349s Jan 17 20:17:56.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.079549184s Jan 17 20:17:58.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.080061409s Jan 17 20:18:00.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.078240521s Jan 17 20:18:02.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.077900752s Jan 17 20:18:04.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.079710669s Jan 17 20:18:06.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.080795946s Jan 17 20:18:08.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.079611134s Jan 17 20:18:10.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.078356918s Jan 17 20:18:12.585: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.089210523s Jan 17 20:18:14.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.07820624s Jan 17 20:18:16.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m16.078914928s Jan 17 20:18:18.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m18.078834747s Jan 17 20:18:20.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m20.078731935s Jan 17 20:18:22.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m22.078874004s Jan 17 20:18:24.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m24.078552384s Jan 17 20:18:26.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m26.078172096s Jan 17 20:18:28.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m28.077367707s Jan 17 20:18:30.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m30.078263946s Jan 17 20:18:32.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m32.078939778s Jan 17 20:18:34.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m34.079541628s Jan 17 20:18:36.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m36.078438763s Jan 17 20:18:38.578: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m38.082037996s Jan 17 20:18:40.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m40.0814112s Jan 17 20:18:42.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m42.07939686s Jan 17 20:18:44.581: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m44.085091024s Jan 17 20:18:46.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m46.080391972s Jan 17 20:18:48.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.077444357s Jan 17 20:18:50.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.080215081s Jan 17 20:18:52.580: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.083908577s Jan 17 20:18:54.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.078959165s Jan 17 20:18:56.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.078876005s Jan 17 20:18:58.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.078762611s Jan 17 20:19:00.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.081332184s Jan 17 20:19:02.580: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m2.084345076s Jan 17 20:19:04.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m4.077752075s Jan 17 20:19:06.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m6.077755013s Jan 17 20:19:08.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m8.077609088s Jan 17 20:19:10.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m10.080073131s Jan 17 20:19:12.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m12.080286839s Jan 17 20:19:14.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m14.080748125s Jan 17 20:19:16.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m16.078725498s Jan 17 20:19:18.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m18.080715842s Jan 17 20:19:20.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m20.080671061s Jan 17 20:19:22.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m22.079226389s Jan 17 20:19:24.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m24.079123854s Jan 17 20:19:26.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m26.077682248s Jan 17 20:19:28.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m28.079699185s Jan 17 20:19:30.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m30.079288063s Jan 17 20:19:32.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.079939726s Jan 17 20:19:34.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.079547215s Jan 17 20:19:36.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.078099411s Jan 17 20:19:38.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.079099767s Jan 17 20:19:40.619: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.123033753s Jan 17 20:19:42.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.07902955s Jan 17 20:19:44.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.078462505s Jan 17 20:19:46.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m46.079596825s Jan 17 20:19:48.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m48.079402538s Jan 17 20:19:50.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m50.079452945s Jan 17 20:19:52.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m52.081396771s Jan 17 20:19:54.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m54.077281628s Jan 17 20:19:56.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m56.08003364s Jan 17 20:19:58.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 8m58.077531493s Jan 17 20:20:00.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m0.077921247s Jan 17 20:20:02.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m2.078677956s Jan 17 20:20:04.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m4.078617047s Jan 17 20:20:06.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m6.080696922s Jan 17 20:20:08.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m8.079173015s Jan 17 20:20:10.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m10.079917335s Jan 17 20:20:12.588: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m12.091992377s Jan 17 20:20:14.627: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m14.131649796s Jan 17 20:20:16.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m16.077787525s Jan 17 20:20:18.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m18.079773128s Jan 17 20:20:20.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m20.077454256s Jan 17 20:20:22.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m22.079342539s Jan 17 20:20:24.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m24.078876851s Jan 17 20:20:26.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m26.078006831s Jan 17 20:20:28.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m28.078469609s Jan 17 20:20:30.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m30.078021187s Jan 17 20:20:32.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m32.079454339s Jan 17 20:20:34.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m34.077824238s Jan 17 20:20:36.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m36.07759608s Jan 17 20:20:38.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m38.077002143s Jan 17 20:20:40.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m40.079892387s Jan 17 20:20:42.576: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m42.080100861s Jan 17 20:20:44.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m44.07745404s Jan 17 20:20:46.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m46.078232667s Jan 17 20:20:48.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m48.079682216s Jan 17 20:20:50.577: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m50.080910702s Jan 17 20:20:52.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m52.077949165s Jan 17 20:20:54.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m54.078623456s Jan 17 20:20:56.574: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m56.078085659s Jan 17 20:20:58.573: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9m58.077367451s Jan 17 20:21:00.575: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 10m0.079780297s Jan 17 20:21:00.614: INFO: Pod "azuredisk-volume-tester-rphdf": Phase="Pending", Reason="", readiness=false. Elapsed: 10m0.118060092s Jan 17 20:21:00.617: INFO: Unexpected error: <*pod.timeoutError | 0xc000d4bef0>: { msg: "timed out while waiting for pod azuredisk-4266/azuredisk-volume-tester-rphdf to be Error status code", observedObjects: [ <*v1.Pod | 0xc000999b00>{ TypeMeta: {Kind: "", APIVersion: ""}, ObjectMeta: { Name: "azuredisk-volume-tester-rphdf", GenerateName: "azuredisk-volume-tester-", Namespace: "azuredisk-4266", SelfLink: "", UID: "2475fd86-eaff-4332-815a-bfe83a7216a6", ResourceVersion: "12399", Generation: 0, CreationTimestamp: { Time: { wall: 0, ext: 63809583060, loc: { name: "Local", zone: [ {name: "UTC", offset: 0, isDST: false}, ], tx: [ { when: -576460752303423488, index: 0, isstd: false, isutc: false, }, ], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: "UTC", offset: 0, isDST: false}, }, }, }, DeletionTimestamp: nil, DeletionGracePeriodSeconds: nil, Labels: nil, Annotations: { "kubernetes.io/psp": "privileged", }, OwnerReferences: nil, Finalizers: nil, ManagedFields: [ { Manager: "e2e.test", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63809583060, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:containers\":{\"k:{\\\"name\\\":\\\"volume-tester\\\"}\":{\".\":{},\"f:args\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{},\"f:volumeMounts\":{\".\":{},\"k:{\\\"mountPath\\\":\\\"/mnt/test-1\\\"}\":{\".\":{},\"f:mountPath\":{},\"f:name\":{},\"f:readOnly\":{}}}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:nodeSelector\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{},\"f:volumes\":{\".\":{},\"k:{\\\"name\\\":\\\"test-volume-1\\\"}\":{\".\":{},\"f:name\":{},\"f:persistentVolumeClaim\":{\".\":{},\"f:claimName\":{}}}}}}", }, Subresource: "", }, { Manager: "kubelet.exe", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63809583060, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}", }, Subresource: "status", }, ], }, Spec: { Volumes: [ { Name: "test-volume-1", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, Secret: nil, NFS: nil, ISCSI: nil, Glusterfs: nil, PersistentVolumeClaim: { ClaimName: "pvc-jdl6w", ReadOnly: false, }, RBD: nil, FlexVolume: nil, Cinder: nil, CephFS: nil, Flocker: nil, DownwardAPI: nil, FC: nil, AzureFile: nil, ConfigMap: nil, VsphereVolume: nil, Quobyte: nil, AzureDisk: nil, PhotonPersistentDisk: nil, Projected: nil, PortworxVolume: nil, ScaleIO: nil, StorageOS: nil, CSI: nil, Ephemeral: nil, }, }, { Name: "kube-api-access-s4nf7", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output Jan 17 20:21:00.617: FAIL: timed out while waiting for pod azuredisk-4266/azuredisk-volume-tester-rphdf to be Error status code Full Stack Trace sigs.k8s.io/azuredisk-csi-driver/test/resources.(*TestPod).WaitForFailure(0x2248837?) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/resources/pod.go:113 +0x77 sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*PreProvisionedReadOnlyVolumeTest).Run(0xc000755dc8, {0x26fb380, 0xc000d12d00}, 0x1?, {0x220ec17, 0x20}) /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/pre_provisioned_read_only_volume_tester.go:57 +0x205 sigs.k8s.io/azuredisk-csi-driver/test/e2e.glob..func4.3.1() /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:156 +0x47d Jan 17 20:21:00.617: INFO: deleting Pod "azuredisk-4266"/"azuredisk-volume-tester-rphdf" Jan 17 20:21:00.695: INFO: Error getting logs for pod azuredisk-volume-tester-rphdf: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-rphdf) �[1mSTEP:�[0m Deleting pod azuredisk-volume-tester-rphdf in namespace azuredisk-4266 �[38;5;243m01/17/23 20:21:00.695�[0m Jan 17 20:21:00.735: INFO: deleting PVC "azuredisk-4266"/"pvc-jdl6w" Jan 17 20:21:00.735: INFO: Deleting PersistentVolumeClaim "pvc-jdl6w" Jan 17 20:21:00.776: INFO: Waiting up to 5m0s for PersistentVolumeClaim pvc-jdl6w to be removed Jan 17 20:22:08.852: INFO: Claim "pvc-jdl6w" in namespace "azuredisk-4266" doesn't exist in the system �[1mSTEP:�[0m deleting PV "azuredisk-4266-disk.csi.azure.com-preprovisioned-pv-fcqpc" �[38;5;243m01/17/23 20:22:08.852�[0m Jan 17 20:22:08.852: INFO: Deleting PersistentVolume "azuredisk-4266-disk.csi.azure.com-preprovisioned-pv-fcqpc" �[1mSTEP:�[0m waiting for claim's PV "azuredisk-4266-disk.csi.azure.com-preprovisioned-pv-fcqpc" to be deleted �[38;5;243m01/17/23 20:22:08.892�[0m Jan 17 20:22:08.892: INFO: Waiting up to 10m0s for PersistentVolume azuredisk-4266-disk.csi.azure.com-preprovisioned-pv-fcqpc to get deleted Jan 17 20:22:08.930: INFO: PersistentVolume azuredisk-4266-disk.csi.azure.com-preprovisioned-pv-fcqpc was removed �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/17/23 20:22:09.744�[0m �[1mSTEP:�[0m Destroying namespace "azuredisk-4266" for this suite. �[38;5;243m01/17/23 20:22:09.744�[0m
Filter through log files | View test history on testgrid
AzureDisk CSI Driver End-to-End Tests [BeforeSuite]
AzureDisk CSI Driver End-to-End Tests [It] AzDiskSchedulerExtender [single-az] Should schedule and start a pod with no persistent volume requests. [Windows]
AzureDisk CSI Driver End-to-End Tests [It] Controller AzDriverNode [single-az] Should create AzDriverNode resource and report heartbeat.
AzureDisk CSI Driver End-to-End Tests [It] Pre-Provisioned [single-az] should succeed when creating a PremiumV2_LRS disk [disk.csi.azure.com][windows]
AzureDisk CSI Driver End-to-End Tests [It] Pre-Provisioned [single-az] should succeed when creating a shared disk [disk.csi.azure.com][windows]
AzureDisk CSI Driver End-to-End Tests [It] Pre-Provisioned [single-az] should use a pre-provisioned volume and retain PV with reclaimPolicy "Retain" [disk.csi.azure.com][windows]
AzureDisk CSI Driver End-to-End Tests [It] AzDiskSchedulerExtender [multi-az] Should schedule and reschedule a pod with a persistent volume request on failover. [Windows]
AzureDisk CSI Driver End-to-End Tests [It] AzDiskSchedulerExtender [multi-az] Should schedule and start a pod with a persistent volume requests. [Windows]
AzureDisk CSI Driver End-to-End Tests [It] AzDiskSchedulerExtender [multi-az] Should schedule and start a pod with multiple persistent volume requests and reschedule on failover.
AzureDisk CSI Driver End-to-End Tests [It] AzDiskSchedulerExtender [multi-az] Should schedule and start a pod with multiple persistent volume requests with replicas and reschedule on deletion.
AzureDisk CSI Driver End-to-End Tests [It] AzDiskSchedulerExtender [multi-az] Should schedule and start a pod with multiple persistent volume requests. [Windows]
AzureDisk CSI Driver End-to-End Tests [It] AzDiskSchedulerExtender [multi-az] Should schedule and start a pod with no persistent volume requests. [Windows]
AzureDisk CSI Driver End-to-End Tests [It] Controller AzVolumeAttachment If a replica is deleted, should create another replica to replace the previous one
AzureDisk CSI Driver End-to-End Tests [It] Controller AzVolumeAttachment If failover happens, should turn replica to primary and create an additional replica for replacement
AzureDisk CSI Driver End-to-End Tests [It] Controller AzVolumeAttachment Should create replica azVolumeAttachment object when maxShares > 1
AzureDisk CSI Driver End-to-End Tests [It] Controller AzVolumeAttachment Should delete AzVolumeAttachment object properly
AzureDisk CSI Driver End-to-End Tests [It] Controller AzVolumeAttachment Should initialize AzVolumeAttachment object's status and append finalizer and create labels
AzureDisk CSI Driver End-to-End Tests [It] Controller AzVolumeAttachment number of replicas should converge to assigned maxMountReplicaCount value
AzureDisk CSI Driver End-to-End Tests [It] Controller AzVolumeAttachment should garbage collect replica AzVolumeAttachment if no promotion or new primary creation happens in a given period of time
AzureDisk CSI Driver End-to-End Tests [It] Controller AzVolumeAttachment should not delete replica AzVolumeAttachment if new primary creation happens within a given period of time after primary failure
AzureDisk CSI Driver End-to-End Tests [It] Controller AzVolumes Should delete AzVolume object
AzureDisk CSI Driver End-to-End Tests [It] Controller AzVolumes Should delete AzVolumeAttachment objects with deletion of AzVolume
AzureDisk CSI Driver End-to-End Tests [It] Controller AzVolumes Should initialize AzVolume object
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should create and attach a volume with advanced perfProfile [enableBursting][disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should create and attach a volume with basic perfProfile [enableBursting][disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should create replicas on node with matching pod affinity
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should create replicas on node with matching pod node affinity
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should create replicas on node with matching pod node selector
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should create replicas spread across zones for zrs
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should not create replicas on node with matching pod anti-affinity
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should not create replicas on node with non-tolerable taint
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should test an increase in replicas when scaling up
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should test pod failover and check for correct number of replicas
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should test pod failover with cordoning a node
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] Should test pod failover with cordoning a node using ZRS
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should check failed replica attachments are recreated after space is made from a volume detaching.
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should clone a volume from an existing volume and read from it [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should clone a volume of larger size than the source volume and make sure the filesystem is appropriately adjusted [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a block volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a deployment object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a pod with multiple volumes [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a pod with volume mount subpath [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a pod, write and read to it, take a volume snapshot, and create another pod from the snapshot [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a pod, write to its pv, take a volume snapshot, overwrite data in original pv, create another pod from the snapshot, and read unaltered original data from original pv[disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a raw block volume and a filesystem volume on demand and bind to the same pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a raw block volume on demand [kubernetes.io/azure-disk] [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a statefulset object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a volume azuredisk with tag [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a volume on demand and resize it [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create a volume on demand with mount options [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create multiple PV objects, bind to PVCs and attach all to a single pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should delete AzVolumeAttachment after pod deleted when maxMountReplicaCount == 0 [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should delete PV with reclaimPolicy "Delete" [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should demote AzVolumeAttachment after pod deleted when maxMountReplicaCount > 0 [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should detach disk after pod deleted when maxMountReplicaCount = 0 [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should receive FailedMount event with invalid mount options [kubernetes.io/azure-disk] [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should retain PV with reclaimPolicy "Retain" [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [multi-az] should succeed when attaching a shared block volume to multiple pods [disk.csi.azure.com][shared disk]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] Should create replicas on node with matching pod affinity
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] Should create replicas on node with matching pod node affinity
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] Should create replicas on node with matching pod node selector
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] Should create replicas spread across zones for zrs
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] Should not create replicas on node with matching pod anti-affinity
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] Should not create replicas on node with non-tolerable taint
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] Should test an increase in replicas when scaling up
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] Should test pod failover and check for correct number of replicas
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] Should test pod failover with cordoning a node
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] Should test pod failover with cordoning a node using ZRS
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should check failed replica attachments are recreated after space is made from a volume detaching.
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should clone a volume from an existing volume and read from it [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should clone a volume of larger size than the source volume and make sure the filesystem is appropriately adjusted [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should create a block volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should create a raw block volume and a filesystem volume on demand and bind to the same pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should create a raw block volume on demand [kubernetes.io/azure-disk] [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should create a statefulset object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should create a volume azuredisk with tag [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should create a volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should delete AzVolumeAttachment after pod deleted when maxMountReplicaCount == 0 [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should demote AzVolumeAttachment after pod deleted when maxMountReplicaCount > 0 [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should detach disk after pod deleted when maxMountReplicaCount = 0 [disk.csi.azure.com] [Windows] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should receive FailedMount event with invalid mount options [kubernetes.io/azure-disk] [disk.csi.azure.com] [csi-azuredisk-scheduler-extender]
AzureDisk CSI Driver End-to-End Tests [It] Dynamic Provisioning [single-az] should succeed when attaching a shared block volume to multiple pods [disk.csi.azure.com][shared disk]
AzureDisk CSI Driver End-to-End Tests [It] Pre-Provisioned [single-az] should create an inline volume by in-tree driver [kubernetes.io/azure-disk]
AzureDisk CSI Driver End-to-End Tests [It] Pre-Provisioned [single-az] should succeed when attaching a shared block volume to multiple pods [disk.csi.azure.com][shared disk]
AzureDisk CSI Driver End-to-End Tests [It] Pre-Provisioned [single-az] should succeed when creating a single pod and with replica attachments [disk.csi.azure.com][csi-azuredisk-scheduler-extender]