Recent runs || View in Spyglass
Result | FAILURE |
Tests | 3 failed / 42 succeeded |
Started | |
Elapsed | 1h13m |
Revision | master |
job-version | v1.21.0-alpha.1.224+ded5726227fbdb |
revision | v1.21.0-alpha.1.224+ded5726227fbdb |
error during /home/prow/go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver/test/run-windows-k8s-integration.sh: exit status 255
from junit_runner.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=External\sStorage\s\[Driver\:\scsi\-gcepd\-sc\-windows\]\s\[Testpattern\:\sPre\-provisioned\sSnapshot\s\(delete\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion$'
/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 Jan 21 18:52:00.879: Unexpected error: <*errors.errorString | 0xc00134c020>: { s: "Failed to find \"hello from snapshotting-8137 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-8137 namespace", last result: "���������������������������������������� " occurred /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268from junit_pdcsi.xml
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 21 18:46:37.077: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] volume snapshot controller /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:176 Jan 21 18:46:37.260: INFO: Creating resource for dynamic PV Jan 21 18:46:37.260: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-8137-e2e-scwhlrb �[1mSTEP�[0m: creating a claim Jan 21 18:46:37.298: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: starting a pod to use the claim Jan 21 18:46:37.431: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-z4zmj" in namespace "snapshotting-8137" to be "Succeeded or Failed" Jan 21 18:46:37.466: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 34.734871ms Jan 21 18:46:39.501: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.07014291s Jan 21 18:46:41.537: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.105537711s Jan 21 18:46:43.573: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.141341382s Jan 21 18:46:45.608: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.176894771s Jan 21 18:46:47.643: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.212148144s Jan 21 18:46:49.679: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 12.247329437s Jan 21 18:46:51.714: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 14.282891224s Jan 21 18:46:53.750: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 16.318439998s Jan 21 18:46:55.785: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 18.353966464s Jan 21 18:46:57.821: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 20.38999886s Jan 21 18:46:59.857: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 22.426051185s Jan 21 18:47:01.893: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 24.461302055s Jan 21 18:47:03.928: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 26.497239255s Jan 21 18:47:05.964: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 28.532766381s Jan 21 18:47:08.007: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 30.575294709s Jan 21 18:47:10.042: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 32.611117037s Jan 21 18:47:12.078: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 34.64663262s Jan 21 18:47:14.113: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 36.682058195s Jan 21 18:47:16.149: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 38.71750157s Jan 21 18:47:18.184: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 40.753277598s Jan 21 18:47:20.226: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 42.795124714s Jan 21 18:47:22.262: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 44.830761095s Jan 21 18:47:24.298: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 46.866616016s Jan 21 18:47:26.335: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 48.903429037s Jan 21 18:47:28.370: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 50.938954629s Jan 21 18:47:30.406: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 52.974524016s Jan 21 18:47:32.481: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 55.049776356s Jan 21 18:47:34.517: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 57.085387758s Jan 21 18:47:36.554: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 59.123023779s Jan 21 18:47:38.590: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.159120058s Jan 21 18:47:40.627: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.195773409s Jan 21 18:47:42.663: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.231696406s Jan 21 18:47:44.699: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.268065741s Jan 21 18:47:46.735: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.303756449s Jan 21 18:47:48.771: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.339415007s Jan 21 18:47:50.810: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.37855085s Jan 21 18:47:52.846: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.414685943s Jan 21 18:47:54.882: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.45114117s Jan 21 18:47:56.919: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.487601731s Jan 21 18:47:58.956: INFO: Pod "pvc-snapshottable-tester-z4zmj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m21.524952545s �[1mSTEP�[0m: Saw pod success Jan 21 18:47:58.956: INFO: Pod "pvc-snapshottable-tester-z4zmj" satisfied condition "Succeeded or Failed" Jan 21 18:47:59.341: INFO: Pod pvc-snapshottable-tester-z4zmj has the following logs: Jan 21 18:47:59.341: INFO: Deleting pod "pvc-snapshottable-tester-z4zmj" in namespace "snapshotting-8137" Jan 21 18:47:59.384: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-z4zmj" to be fully deleted Jan 21 18:47:59.419: INFO: Waiting up to 5m0s for PersistentVolumeClaims [csi-gcepd-sc-windowsxd4gx] to have phase Bound Jan 21 18:47:59.454: INFO: PersistentVolumeClaim csi-gcepd-sc-windowsxd4gx found and phase=Bound (35.273521ms) �[1mSTEP�[0m: checking the claim �[1mSTEP�[0m: checking the PV [BeforeEach] /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:190 �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jan 21 18:47:59.640: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-g8wx8 to become ready Jan 21 18:47:59.693: INFO: VolumeSnapshot snapshot-g8wx8 found but is not ready. Jan 21 18:48:01.730: INFO: VolumeSnapshot snapshot-g8wx8 found but is not ready. Jan 21 18:48:03.802: INFO: VolumeSnapshot snapshot-g8wx8 found but is not ready. Jan 21 18:48:05.839: INFO: VolumeSnapshot snapshot-g8wx8 found but is not ready. Jan 21 18:48:07.875: INFO: VolumeSnapshot snapshot-g8wx8 found but is not ready. Jan 21 18:48:09.911: INFO: VolumeSnapshot snapshot-g8wx8 found but is not ready. Jan 21 18:48:11.948: INFO: VolumeSnapshot snapshot-g8wx8 found but is not ready. Jan 21 18:48:13.985: INFO: VolumeSnapshot snapshot-g8wx8 found but is not ready. Jan 21 18:48:16.021: INFO: VolumeSnapshot snapshot-g8wx8 found and is ready Jan 21 18:48:16.021: INFO: WaitUntil finished successfully after 16.380995694s Jan 21 18:48:16.061: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-6c86cfcf-fa94-44c7-843e-f543842b4bde creationTime:2021-01-21T18:48:00Z readyToUse:true restoreSize:5Gi] Jan 21 18:48:16.061: INFO: snapshotContentName snapcontent-6c86cfcf-fa94-44c7-843e-f543842b4bde �[1mSTEP�[0m: updating the snapshot content deletion policy to retain �[1mSTEP�[0m: recording the volume handle and snapshotHandle Jan 21 18:48:16.138: INFO: Recording snapshot handle: projects/k8s-boskos-gce-project-19/global/snapshots/snapshot-6c86cfcf-fa94-44c7-843e-f543842b4bde �[1mSTEP�[0m: deleting the snapshot and snapshot content �[1mSTEP�[0m: checking the Snapshot has been deleted Jan 21 18:48:16.178: INFO: Waiting up to 5m0s for volumesnapshots snapshotting-8137 to be deleted Jan 21 18:48:16.227: INFO: volumesnapshots snapshotting-8137 is not found in namespace snapshot-g8wx8 and has been deleted Jan 21 18:48:16.227: INFO: WaitUntil finished successfully after 48.378049ms �[1mSTEP�[0m: checking the Snapshot content has been deleted Jan 21 18:48:16.277: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-6c86cfcf-fa94-44c7-843e-f543842b4bde to be deleted Jan 21 18:48:16.317: INFO: volumesnapshotcontents snapcontent-6c86cfcf-fa94-44c7-843e-f543842b4bde is not found and has been deleted Jan 21 18:48:16.318: INFO: WaitUntil finished successfully after 40.552198ms �[1mSTEP�[0m: creating a snapshot content with the snapshot handle �[1mSTEP�[0m: creating a snapshot with that snapshot content Jan 21 18:48:16.397: INFO: Waiting up to 5m0s for VolumeSnapshot pre-provisioned-snapshot-af11247e-4f25-43fb-afdd-95d78425bc23 to become ready Jan 21 18:48:16.433: INFO: VolumeSnapshot pre-provisioned-snapshot-af11247e-4f25-43fb-afdd-95d78425bc23 found but is not ready. Jan 21 18:48:18.472: INFO: VolumeSnapshot pre-provisioned-snapshot-af11247e-4f25-43fb-afdd-95d78425bc23 found and is ready Jan 21 18:48:18.473: INFO: WaitUntil finished successfully after 2.075164641s �[1mSTEP�[0m: getting the snapshot and snapshot content [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: Modifying source data test �[1mSTEP�[0m: modifying the data in the source PVC Jan 21 18:48:18.654: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-sp8v7" in namespace "snapshotting-8137" to be "Succeeded or Failed" Jan 21 18:48:18.689: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 34.907291ms Jan 21 18:48:20.726: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071947068s Jan 21 18:48:22.762: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.107774239s Jan 21 18:48:24.798: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.143675408s Jan 21 18:48:26.834: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.18003589s Jan 21 18:48:28.870: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 10.215843717s Jan 21 18:48:30.906: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 12.251317454s Jan 21 18:48:32.941: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 14.286951693s Jan 21 18:48:34.978: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 16.324010675s Jan 21 18:48:37.016: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 18.361361389s Jan 21 18:48:39.052: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 20.397157339s Jan 21 18:48:41.087: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 22.432831576s Jan 21 18:48:43.123: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 24.469069545s Jan 21 18:48:45.159: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 26.504979183s Jan 21 18:48:47.195: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 28.540813433s Jan 21 18:48:49.230: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 30.576087491s Jan 21 18:48:51.266: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 32.611595897s Jan 21 18:48:53.302: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 34.647345193s Jan 21 18:48:55.338: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 36.683418657s Jan 21 18:48:57.376: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 38.721861454s Jan 21 18:48:59.412: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 40.757451727s Jan 21 18:49:01.465: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 42.810586692s Jan 21 18:49:03.500: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 44.846065906s Jan 21 18:49:05.536: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 46.88198717s Jan 21 18:49:07.576: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 48.921239215s Jan 21 18:49:09.611: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 50.957131741s Jan 21 18:49:11.647: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 52.992907385s Jan 21 18:49:13.683: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 55.028399449s Jan 21 18:49:15.719: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 57.06423755s Jan 21 18:49:17.754: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 59.100124431s Jan 21 18:49:19.791: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.136367531s Jan 21 18:49:21.826: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.171681901s Jan 21 18:49:23.862: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Running", Reason="", readiness=true. Elapsed: 1m5.207160708s Jan 21 18:49:25.897: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Running", Reason="", readiness=true. Elapsed: 1m7.243113234s Jan 21 18:49:27.933: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Running", Reason="", readiness=true. Elapsed: 1m9.278910764s Jan 21 18:49:29.973: INFO: Pod "pvc-snapshottable-data-tester-sp8v7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m11.318204742s �[1mSTEP�[0m: Saw pod success Jan 21 18:49:29.973: INFO: Pod "pvc-snapshottable-data-tester-sp8v7" satisfied condition "Succeeded or Failed" Jan 21 18:49:30.076: INFO: Pod pvc-snapshottable-data-tester-sp8v7 has the following logs: Jan 21 18:49:30.076: INFO: Deleting pod "pvc-snapshottable-data-tester-sp8v7" in namespace "snapshotting-8137" Jan 21 18:49:30.125: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-sp8v7" to be fully deleted �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the claim Jan 21 18:51:00.335: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:02.396: INFO: stderr: "" Jan 21 18:51:02.396: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:04.397: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:06.367: INFO: stderr: "" Jan 21 18:51:06.367: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:08.368: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:11.874: INFO: stderr: "" Jan 21 18:51:11.874: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:13.875: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:15.584: INFO: stderr: "" Jan 21 18:51:15.584: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:17.584: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:20.319: INFO: stderr: "" Jan 21 18:51:20.319: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:22.320: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:23.604: INFO: stderr: "" Jan 21 18:51:23.604: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:25.605: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:27.005: INFO: stderr: "" Jan 21 18:51:27.005: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:29.005: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:30.150: INFO: stderr: "" Jan 21 18:51:30.150: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:32.150: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:33.250: INFO: stderr: "" Jan 21 18:51:33.250: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:35.250: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:36.331: INFO: stderr: "" Jan 21 18:51:36.331: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:38.331: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:39.810: INFO: stderr: "" Jan 21 18:51:39.810: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:41.810: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:42.923: INFO: stderr: "" Jan 21 18:51:42.923: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:44.923: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:46.031: INFO: stderr: "" Jan 21 18:51:46.031: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:48.031: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:49.171: INFO: stderr: "" Jan 21 18:51:49.171: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:51.171: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:52.620: INFO: stderr: "" Jan 21 18:51:52.621: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:54.621: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:55.722: INFO: stderr: "" Jan 21 18:51:55.722: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:57.723: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8137 exec restored-pvc-tester-dwjtc --namespace=snapshotting-8137 -- powershell /c type /mnt/test/data' Jan 21 18:51:58.879: INFO: stderr: "" Jan 21 18:51:58.879: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:52:00.879: FAIL: Unexpected error: <*errors.errorString | 0xc00134c020>: { s: "Failed to find \"hello from snapshotting-8137 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-8137 namespace", last result: "���������������������������������������� " occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.5.2() /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268 +0x1254 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0016e4a80) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc0016e4a80) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc0016e4a80, 0x4ff25a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] volume snapshot controller /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:179 Jan 21 18:52:00.942: INFO: Pod restored-pvc-tester-dwjtc has the following logs: Jan 21 18:52:00.942: INFO: Deleting pod "restored-pvc-tester-dwjtc" in namespace "snapshotting-8137" Jan 21 18:52:00.979: INFO: Wait up to 5m0s for pod "restored-pvc-tester-dwjtc" to be fully deleted Jan 21 18:52:07.050: INFO: deleting claim "snapshotting-8137"/"pvc-nnt62" Jan 21 18:52:07.088: INFO: deleting snapshot "snapshotting-8137"/"pre-provisioned-snapshot-af11247e-4f25-43fb-afdd-95d78425bc23" Jan 21 18:52:07.127: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:pre-provisioned-snapcontent-af11247e-4f25-43fb-afdd-95d78425bc23 creationTime:2021-01-21T18:48:00Z readyToUse:true restoreSize:5Gi] Jan 21 18:52:07.127: INFO: snapshotContentName pre-provisioned-snapcontent-af11247e-4f25-43fb-afdd-95d78425bc23 Jan 21 18:52:07.203: INFO: Waiting up to 5m0s for volumesnapshotcontents pre-provisioned-snapcontent-af11247e-4f25-43fb-afdd-95d78425bc23 to be deleted Jan 21 18:52:07.247: INFO: volumesnapshotcontents pre-provisioned-snapcontent-af11247e-4f25-43fb-afdd-95d78425bc23 has been found and is not deleted Jan 21 18:52:09.283: INFO: volumesnapshotcontents pre-provisioned-snapcontent-af11247e-4f25-43fb-afdd-95d78425bc23 has been found and is not deleted Jan 21 18:52:11.318: INFO: volumesnapshotcontents pre-provisioned-snapcontent-af11247e-4f25-43fb-afdd-95d78425bc23 is not found and has been deleted Jan 21 18:52:11.318: INFO: WaitUntil finished successfully after 4.115403697s Jan 21 18:52:11.319: INFO: deleting snapshot content "pre-provisioned-snapcontent-af11247e-4f25-43fb-afdd-95d78425bc23" Jan 21 18:52:11.353: INFO: deleting snapshot class "snapshotting-8137-vscgqxhr" Jan 21 18:52:11.392: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-8137-vscgqxhr to be deleted Jan 21 18:52:11.427: INFO: volumesnapshotclasses snapshotting-8137-vscgqxhr is not found and has been deleted Jan 21 18:52:11.427: INFO: WaitUntil finished successfully after 35.130535ms �[1mSTEP�[0m: Deleting pvc Jan 21 18:52:11.497: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windowsxd4gx" Jan 21 18:52:11.534: INFO: Waiting up to 5m0s for PersistentVolume pvc-1031da6d-661c-4b9b-a17e-c1fd19f4e3ee to get deleted Jan 21 18:52:11.569: INFO: PersistentVolume pvc-1031da6d-661c-4b9b-a17e-c1fd19f4e3ee found and phase=Released (34.547376ms) Jan 21 18:52:16.605: INFO: PersistentVolume pvc-1031da6d-661c-4b9b-a17e-c1fd19f4e3ee was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-8137". �[1mSTEP�[0m: Found 26 events. Jan 21 18:52:16.682: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-data-tester-sp8v7: { } Scheduled: Successfully assigned snapshotting-8137/pvc-snapshottable-data-tester-sp8v7 to e2e-92e2afceff-9cdc3-windows-node-group-pgws Jan 21 18:52:16.682: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-tester-z4zmj: { } Scheduled: Successfully assigned snapshotting-8137/pvc-snapshottable-tester-z4zmj to e2e-92e2afceff-9cdc3-windows-node-group-z0ng Jan 21 18:52:16.682: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for restored-pvc-tester-dwjtc: { } Scheduled: Successfully assigned snapshotting-8137/restored-pvc-tester-dwjtc to e2e-92e2afceff-9cdc3-windows-node-group-z0ng Jan 21 18:52:16.682: INFO: At 2021-01-21 18:46:37 +0000 UTC - event for csi-gcepd-sc-windowsxd4gx: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 21 18:52:16.682: INFO: At 2021-01-21 18:46:37 +0000 UTC - event for csi-gcepd-sc-windowsxd4gx: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 21 18:52:16.682: INFO: At 2021-01-21 18:46:37 +0000 UTC - event for csi-gcepd-sc-windowsxd4gx: {pd.csi.storage.gke.io_e2e-92e2afceff-9cdc3-minion-group-c8gb_32631f8a-44bf-4822-a433-c3a5da6f0587 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-8137/csi-gcepd-sc-windowsxd4gx" Jan 21 18:52:16.682: INFO: At 2021-01-21 18:46:41 +0000 UTC - event for csi-gcepd-sc-windowsxd4gx: {pd.csi.storage.gke.io_e2e-92e2afceff-9cdc3-minion-group-c8gb_32631f8a-44bf-4822-a433-c3a5da6f0587 } ProvisioningSucceeded: Successfully provisioned volume pvc-1031da6d-661c-4b9b-a17e-c1fd19f4e3ee Jan 21 18:52:16.682: INFO: At 2021-01-21 18:46:54 +0000 UTC - event for pvc-snapshottable-tester-z4zmj: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-1031da6d-661c-4b9b-a17e-c1fd19f4e3ee" Jan 21 18:52:16.682: INFO: At 2021-01-21 18:47:43 +0000 UTC - event for pvc-snapshottable-tester-z4zmj: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-z0ng} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 21 18:52:16.682: INFO: At 2021-01-21 18:47:44 +0000 UTC - event for pvc-snapshottable-tester-z4zmj: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-z0ng} Created: Created container volume-tester Jan 21 18:52:16.682: INFO: At 2021-01-21 18:47:47 +0000 UTC - event for pvc-snapshottable-tester-z4zmj: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-z0ng} Started: Started container volume-tester Jan 21 18:52:16.682: INFO: At 2021-01-21 18:47:59 +0000 UTC - event for snapshot-g8wx8: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-8137/snapshot-g8wx8 to be created by the CSI driver. Jan 21 18:52:16.682: INFO: At 2021-01-21 18:48:18 +0000 UTC - event for pvc-snapshottable-data-tester-sp8v7: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-1031da6d-661c-4b9b-a17e-c1fd19f4e3ee" Volume is already exclusively attached to one node and can't be attached to another Jan 21 18:52:16.682: INFO: At 2021-01-21 18:48:43 +0000 UTC - event for pvc-snapshottable-data-tester-sp8v7: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-1031da6d-661c-4b9b-a17e-c1fd19f4e3ee" Jan 21 18:52:16.682: INFO: At 2021-01-21 18:49:17 +0000 UTC - event for pvc-snapshottable-data-tester-sp8v7: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-pgws} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 21 18:52:16.682: INFO: At 2021-01-21 18:49:18 +0000 UTC - event for pvc-snapshottable-data-tester-sp8v7: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-pgws} Created: Created container volume-tester Jan 21 18:52:16.682: INFO: At 2021-01-21 18:49:19 +0000 UTC - event for pvc-snapshottable-data-tester-sp8v7: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-pgws} Started: Started container volume-tester Jan 21 18:52:16.682: INFO: At 2021-01-21 18:49:30 +0000 UTC - event for pvc-nnt62: {pd.csi.storage.gke.io_e2e-92e2afceff-9cdc3-minion-group-c8gb_32631f8a-44bf-4822-a433-c3a5da6f0587 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-8137/pvc-nnt62" Jan 21 18:52:16.682: INFO: At 2021-01-21 18:49:30 +0000 UTC - event for pvc-nnt62: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 21 18:52:16.682: INFO: At 2021-01-21 18:49:30 +0000 UTC - event for pvc-nnt62: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 21 18:52:16.682: INFO: At 2021-01-21 18:49:52 +0000 UTC - event for pvc-nnt62: {pd.csi.storage.gke.io_e2e-92e2afceff-9cdc3-minion-group-c8gb_32631f8a-44bf-4822-a433-c3a5da6f0587 } ProvisioningSucceeded: Successfully provisioned volume pvc-3db155b8-3e9f-4ec8-8ba3-bbbb05f767c0 Jan 21 18:52:16.682: INFO: At 2021-01-21 18:50:05 +0000 UTC - event for restored-pvc-tester-dwjtc: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-3db155b8-3e9f-4ec8-8ba3-bbbb05f767c0" Jan 21 18:52:16.682: INFO: At 2021-01-21 18:50:47 +0000 UTC - event for restored-pvc-tester-dwjtc: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-z0ng} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 21 18:52:16.682: INFO: At 2021-01-21 18:50:48 +0000 UTC - event for restored-pvc-tester-dwjtc: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-z0ng} Created: Created container volume-tester Jan 21 18:52:16.682: INFO: At 2021-01-21 18:50:52 +0000 UTC - event for restored-pvc-tester-dwjtc: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-z0ng} Started: Started container volume-tester Jan 21 18:52:16.682: INFO: At 2021-01-21 18:52:00 +0000 UTC - event for restored-pvc-tester-dwjtc: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-z0ng} Killing: Stopping container volume-tester Jan 21 18:52:16.717: INFO: POD NODE PHASE GRACE CONDITIONS Jan 21 18:52:16.717: INFO: Jan 21 18:52:16.762: INFO: Logging node info for node e2e-92e2afceff-9cdc3-master Jan 21 18:52:16.799: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-master 7be0f5a4-3bf2-41f4-a4a2-bd4881522cda 7407 0 2021-01-21 18:07:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-21 18:07:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2021-01-21 18:37:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-21 18:41:36 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3866853376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3604709376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:07:16 +0000 UTC,LastTransitionTime:2021-01-21 18:07:16 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:104.198.7.44,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-master.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-master.c.k8s-boskos-gce-project-19.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:17278a3690a17ad962a99cffc578e964,SystemUUID:17278a36-90a1-7ad9-62a9-9cffc578e964,BootID:a1c3cec6-5edf-4c6c-bcee-d88ace424b19,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.21.0-alpha.1.224_ded5726227fbdb],SizeBytes:123001134,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.21.0-alpha.1.224_ded5726227fbdb],SizeBytes:117520714,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:70314486,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.21.0-alpha.1.224_ded5726227fbdb],SizeBytes:47716663,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 21 18:52:16.799: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-master Jan 21 18:52:16.837: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-master Jan 21 18:52:16.890: INFO: kube-addon-manager-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:06:51 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:16.890: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 21 18:52:16.890: INFO: l7-lb-controller-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:07:01 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:16.890: INFO: Container l7-lb-controller ready: true, restart count 0 Jan 21 18:52:16.890: INFO: csi-gce-pd-node-q5d7p started at 2021-01-21 18:37:00 +0000 UTC (0+2 container statuses recorded) Jan 21 18:52:16.890: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 18:52:16.890: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 18:52:16.890: INFO: etcd-server-events-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:05:55 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:16.890: INFO: Container etcd-container ready: true, restart count 0 Jan 21 18:52:16.890: INFO: etcd-server-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:06:05 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:16.890: INFO: Container etcd-container ready: true, restart count 0 Jan 21 18:52:16.890: INFO: kube-scheduler-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:06:35 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:16.890: INFO: Container kube-scheduler ready: true, restart count 0 Jan 21 18:52:16.890: INFO: metadata-proxy-v0.1-j6fg6 started at 2021-01-21 18:07:35 +0000 UTC (0+2 container statuses recorded) Jan 21 18:52:16.890: INFO: Container metadata-proxy ready: true, restart count 0 Jan 21 18:52:16.890: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 21 18:52:16.890: INFO: kube-apiserver-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:06:15 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:16.890: INFO: Container kube-apiserver ready: true, restart count 0 Jan 21 18:52:16.890: INFO: kube-controller-manager-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:06:25 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:16.890: INFO: Container kube-controller-manager ready: true, restart count 0 W0121 18:52:16.940648 68817 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:52:17.223: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-master Jan 21 18:52:17.223: INFO: Logging node info for node e2e-92e2afceff-9cdc3-minion-group-c8gb Jan 21 18:52:17.260: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-minion-group-c8gb 14bc41b1-d9b1-4e9a-999d-1762d91dce7a 7406 0 2021-01-21 18:07:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-minion-group-c8gb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-minion-group-c8gb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-21 18:07:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-21 18:07:28 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-21 18:37:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-21 18:41:36 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-minion-group-c8gb,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-21 18:47:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-21 18:47:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-21 18:47:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-21 18:47:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-21 18:47:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-21 18:47:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-21 18:47:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:07:23 +0000 UTC,LastTransitionTime:2021-01-21 18:07:23 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.24.255,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-minion-group-c8gb.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-minion-group-c8gb.c.k8s-boskos-gce-project-19.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:42dd67036582d457d9babc45a4667de4,SystemUUID:42dd6703-6582-d457-d9ba-bc45a4667de4,BootID:de7b2e6e-bff1-431c-9854-67870cf0dee8,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.224_ded5726227fbdb],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:70314486,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:bec571992d40203edcd056ac0b0d97003887ee5e4be144c41932d18639673b03 k8s.gcr.io/sig-storage/csi-provisioner:v2.0.4],SizeBytes:20428748,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:e5ce22ddc2a6fbc9b5729dbcfaf1159c4b0d48dad62ddd1b93503c1348e4a406 k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.1],SizeBytes:19498883,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:ca160717df7f6b7964c936faf608b914f2277363e6d708ea2e2dbbf2c5f56a83 k8s.gcr.io/sig-storage/csi-resizer:v1.0.1],SizeBytes:19463877,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:7495d30800fb3ef22f3dc6d5fe9a0a6ec40ba32a2bdc0cf5e7fcaa507adc921e k8s.gcr.io/sig-storage/csi-attacher:v3.0.1],SizeBytes:19460260,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 21 18:52:17.261: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-minion-group-c8gb Jan 21 18:52:17.298: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-minion-group-c8gb Jan 21 18:52:17.364: INFO: csi-gce-pd-controller-59f869d4f8-ch6pq started at 2021-01-21 18:37:00 +0000 UTC (0+5 container statuses recorded) Jan 21 18:52:17.364: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 18:52:17.364: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 18:52:17.364: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 18:52:17.364: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 18:52:17.364: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 18:52:17.364: INFO: metrics-server-v0.3.6-8b98f98c9-mjgkx started at 2021-01-21 18:08:07 +0000 UTC (0+2 container statuses recorded) Jan 21 18:52:17.364: INFO: Container metrics-server ready: true, restart count 0 Jan 21 18:52:17.364: INFO: Container metrics-server-nanny ready: true, restart count 0 Jan 21 18:52:17.364: INFO: csi-gce-pd-node-wnc2q started at 2021-01-21 18:37:00 +0000 UTC (0+2 container statuses recorded) Jan 21 18:52:17.364: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 18:52:17.364: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 18:52:17.364: INFO: kube-proxy-e2e-92e2afceff-9cdc3-minion-group-c8gb started at 2021-01-21 18:07:22 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:17.364: INFO: Container kube-proxy ready: true, restart count 0 Jan 21 18:52:17.364: INFO: metadata-proxy-v0.1-6k6bx started at 2021-01-21 18:07:23 +0000 UTC (0+2 container statuses recorded) Jan 21 18:52:17.364: INFO: Container metadata-proxy ready: true, restart count 0 Jan 21 18:52:17.364: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 21 18:52:17.364: INFO: kube-dns-autoscaler-76478fcf46-hbkx5 started at 2021-01-21 18:07:33 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:17.364: INFO: Container autoscaler ready: true, restart count 0 Jan 21 18:52:17.364: INFO: l7-default-backend-6dd8477499-fp2vv started at 2021-01-21 18:07:34 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:17.364: INFO: Container default-http-backend ready: true, restart count 0 Jan 21 18:52:17.364: INFO: coredns-6954c77b9b-5p2c9 started at 2021-01-21 18:07:36 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:17.364: INFO: Container coredns ready: true, restart count 0 W0121 18:52:17.405899 68817 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:52:17.657: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-minion-group-c8gb Jan 21 18:52:17.657: INFO: Logging node info for node e2e-92e2afceff-9cdc3-minion-group-gsrb Jan 21 18:52:17.694: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-minion-group-gsrb 93e3ee37-2ba2-4475-bd9c-c558034d35af 7411 0 2021-01-21 18:07:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-minion-group-gsrb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-minion-group-gsrb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-21 18:07:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.5.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-21 18:07:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-21 18:37:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-21 18:41:36 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.5.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-minion-group-gsrb,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.5.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-21 18:47:29 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-21 18:47:29 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-21 18:47:29 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-21 18:47:29 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-21 18:47:29 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-21 18:47:29 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-21 18:47:29 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:07:23 +0000 UTC,LastTransitionTime:2021-01-21 18:07:23 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:47:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.7,},NodeAddress{Type:ExternalIP,Address:34.82.29.73,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-minion-group-gsrb.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-minion-group-gsrb.c.k8s-boskos-gce-project-19.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:62a1a3950cce8cc6e9c6d37bac3f10ad,SystemUUID:62a1a395-0cce-8cc6-e9c6-d37bac3f10ad,BootID:4d229fc6-5a17-409c-b10d-6e37c5845745,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.224_ded5726227fbdb],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:70314486,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:a494ff6ec10e05a454458fbf44247d93c9b3a0d983a00b538e442f353b7030c8 k8s.gcr.io/sig-storage/snapshot-controller:v3.0.2],SizeBytes:17461280,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 21 18:52:17.694: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-minion-group-gsrb Jan 21 18:52:17.731: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-minion-group-gsrb Jan 21 18:52:17.795: INFO: metadata-proxy-v0.1-2k99q started at 2021-01-21 18:07:23 +0000 UTC (0+2 container statuses recorded) Jan 21 18:52:17.795: INFO: Container metadata-proxy ready: true, restart count 0 Jan 21 18:52:17.795: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 21 18:52:17.795: INFO: volume-snapshot-controller-0 started at 2021-01-21 18:07:33 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:17.795: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jan 21 18:52:17.795: INFO: csi-gce-pd-node-vbbp4 started at 2021-01-21 18:37:00 +0000 UTC (0+2 container statuses recorded) Jan 21 18:52:17.795: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 18:52:17.795: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 18:52:17.795: INFO: coredns-6954c77b9b-5xnq4 started at 2021-01-21 18:07:41 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:17.795: INFO: Container coredns ready: true, restart count 0 Jan 21 18:52:17.795: INFO: kube-proxy-e2e-92e2afceff-9cdc3-minion-group-gsrb started at 2021-01-21 18:07:23 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:17.795: INFO: Container kube-proxy ready: true, restart count 0 W0121 18:52:17.841465 68817 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:52:18.005: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-minion-group-gsrb Jan 21 18:52:18.005: INFO: Logging node info for node e2e-92e2afceff-9cdc3-windows-node-group-099x Jan 21 18:52:18.042: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-windows-node-group-099x 8ebd0400-36b4-426c-ad95-00672f6e8a05 8769 0 2021-01-21 18:09:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-windows-node-group-099x kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-windows-node-group-099x"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-21 18:46:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-21 18:46:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-windows-node-group-099x,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:09:58 +0000 UTC,LastTransitionTime:2021-01-21 18:09:58 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:51:21 +0000 UTC,LastTransitionTime:2021-01-21 18:09:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:51:21 +0000 UTC,LastTransitionTime:2021-01-21 18:09:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:51:21 +0000 UTC,LastTransitionTime:2021-01-21 18:09:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:51:21 +0000 UTC,LastTransitionTime:2021-01-21 18:10:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.83.184.35,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-windows-node-group-099x.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-windows-node-group-099x,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-92e2afceff-9cdc3-windows-node-group-099x,SystemUUID:0DED9D31-AD1A-038B-7E10-151153FE50EA,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-4fcf5a69-8705-4fea-80b2-c49eec4644d6 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-53fa8a8a-1440-4d5a-a483-dbf801a9345b kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-f1bc320a-ac15-4631-8483-eb5085a36460],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-4fcf5a69-8705-4fea-80b2-c49eec4644d6,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-53fa8a8a-1440-4d5a-a483-dbf801a9345b,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-f1bc320a-ac15-4631-8483-eb5085a36460,DevicePath:,},},Config:nil,},} Jan 21 18:52:18.042: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-windows-node-group-099x Jan 21 18:52:18.079: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-windows-node-group-099x Jan 21 18:52:18.230: INFO: restored-pvc-tester-smhw7 started at 2021-01-21 18:50:43 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:18.230: INFO: Container volume-tester ready: true, restart count 0 Jan 21 18:52:18.230: INFO: csi-gce-pd-node-win-xzr5l started at 2021-01-21 18:37:01 +0000 UTC (0+2 container statuses recorded) Jan 21 18:52:18.230: INFO: Container csi-driver-registrar ready: true, restart count 1 Jan 21 18:52:18.230: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 18:52:18.230: INFO: pvc-snapshottable-tester-m6zph started at 2021-01-21 18:50:56 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:18.230: INFO: Container volume-tester ready: false, restart count 0 Jan 21 18:52:18.230: INFO: external-client started at 2021-01-21 18:51:20 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:18.230: INFO: Container external-client ready: false, restart count 0 W0121 18:52:18.273585 68817 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:52:27.461: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-windows-node-group-099x Jan 21 18:52:27.461: INFO: Logging node info for node e2e-92e2afceff-9cdc3-windows-node-group-pgws Jan 21 18:52:27.497: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-windows-node-group-pgws 446fc7c3-e45e-4731-834e-b50ec7dda462 8724 0 2021-01-21 18:09:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-windows-node-group-pgws kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-windows-node-group-pgws"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-21 18:42:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-21 18:42:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-windows-node-group-pgws,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:09:55 +0000 UTC,LastTransitionTime:2021-01-21 18:09:55 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:51:18 +0000 UTC,LastTransitionTime:2021-01-21 18:09:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:51:18 +0000 UTC,LastTransitionTime:2021-01-21 18:09:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:51:18 +0000 UTC,LastTransitionTime:2021-01-21 18:09:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:51:18 +0000 UTC,LastTransitionTime:2021-01-21 18:10:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:104.196.255.127,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-windows-node-group-pgws.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-windows-node-group-pgws,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-92e2afceff-9cdc3-windows-node-group-pgws,SystemUUID:8FD7163A-577B-1D7D-0B03-7AFFABCA3DFB,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-eaa5f1d3-710e-4434-a1b4-804e60763138 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-f301ce0c-1ffe-4266-ba51-710d12aa5a9a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-f301ce0c-1ffe-4266-ba51-710d12aa5a9a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-eaa5f1d3-710e-4434-a1b4-804e60763138,DevicePath:,},},Config:nil,},} Jan 21 18:52:27.497: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-windows-node-group-pgws Jan 21 18:52:27.534: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-windows-node-group-pgws Jan 21 18:52:27.695: INFO: csi-gce-pd-node-win-drggr started at 2021-01-21 18:37:00 +0000 UTC (0+2 container statuses recorded) Jan 21 18:52:27.695: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 18:52:27.695: INFO: Container gce-pd-driver ready: true, restart count 1 Jan 21 18:52:27.695: INFO: pod-subpath-test-dynamicpv-6sd8 started at 2021-01-21 18:51:08 +0000 UTC (2+2 container statuses recorded) Jan 21 18:52:27.695: INFO: Init container init-volume-dynamicpv-6sd8 ready: false, restart count 0 Jan 21 18:52:27.695: INFO: Init container test-init-subpath-dynamicpv-6sd8 ready: false, restart count 0 Jan 21 18:52:27.695: INFO: Container test-container-subpath-dynamicpv-6sd8 ready: false, restart count 0 Jan 21 18:52:27.695: INFO: Container test-container-volume-dynamicpv-6sd8 ready: false, restart count 0 Jan 21 18:52:27.695: INFO: pod-subpath-test-dynamicpv-pnrd started at 2021-01-21 18:50:08 +0000 UTC (1+2 container statuses recorded) Jan 21 18:52:27.695: INFO: Init container init-volume-dynamicpv-pnrd ready: true, restart count 0 Jan 21 18:52:27.695: INFO: Container test-container-subpath-dynamicpv-pnrd ready: true, restart count 1 Jan 21 18:52:27.695: INFO: Container test-container-volume-dynamicpv-pnrd ready: true, restart count 0 W0121 18:52:27.739703 68817 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:52:38.108: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-windows-node-group-pgws Jan 21 18:52:38.108: INFO: Logging node info for node e2e-92e2afceff-9cdc3-windows-node-group-z0ng Jan 21 18:52:38.144: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-windows-node-group-z0ng fea1e475-2aa8-4e45-b125-332cf61ced06 9018 0 2021-01-21 18:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-windows-node-group-z0ng kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-windows-node-group-z0ng"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-21 18:42:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-21 18:45:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-windows-node-group-z0ng,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:09:42 +0000 UTC,LastTransitionTime:2021-01-21 18:09:42 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:30 +0000 UTC,LastTransitionTime:2021-01-21 18:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:30 +0000 UTC,LastTransitionTime:2021-01-21 18:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:30 +0000 UTC,LastTransitionTime:2021-01-21 18:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:52:30 +0000 UTC,LastTransitionTime:2021-01-21 18:09:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.105.57.214,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-windows-node-group-z0ng.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-windows-node-group-z0ng,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-92e2afceff-9cdc3-windows-node-group-z0ng,SystemUUID:B9239180-7AFD-487C-8A4F-3B2B72E8705D,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-a35753f2-3a73-4116-9c85-acfa00ccec9e kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-f59037f4-3c92-45b3-b2c2-4921ecc92972],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-f59037f4-3c92-45b3-b2c2-4921ecc92972,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-a35753f2-3a73-4116-9c85-acfa00ccec9e,DevicePath:,},},Config:nil,},} Jan 21 18:52:38.144: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-windows-node-group-z0ng Jan 21 18:52:38.182: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-windows-node-group-z0ng Jan 21 18:52:38.377: INFO: csi-gce-pd-node-win-2zw4k started at 2021-01-21 18:37:01 +0000 UTC (0+2 container statuses recorded) Jan 21 18:52:38.377: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 18:52:38.377: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 18:52:38.377: INFO: external-injector started at 2021-01-21 18:51:48 +0000 UTC (0+1 container statuses recorded) Jan 21 18:52:38.377: INFO: Container external-injector ready: false, restart count 0 W0121 18:52:38.419903 68817 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:52:41.454: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-windows-node-group-z0ng Jan 21 18:52:41.454: INFO: Waiting up to 3m0s for all (but 3) nodes to be ready �[1mSTEP�[0m: Destroying namespace "snapshotting-8137" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=External\sStorage\s\[Driver\:\scsi\-gcepd\-sc\-windows\]\s\[Testpattern\:\sPre\-provisioned\sSnapshot\s\(retain\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion$'
/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 Jan 21 18:52:48.180: Unexpected error: <*errors.errorString | 0xc003ef8070>: { s: "Failed to find \"hello from snapshotting-4174 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-4174 namespace", last result: "���������������������������������������� " occurred /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268from junit_pdcsi.xml
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 21 18:46:33.737: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] volume snapshot controller /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:176 Jan 21 18:46:33.920: INFO: Creating resource for dynamic PV Jan 21 18:46:33.920: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-4174-e2e-sc4tght �[1mSTEP�[0m: creating a claim Jan 21 18:46:33.958: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: starting a pod to use the claim Jan 21 18:46:34.071: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-n7tdt" in namespace "snapshotting-4174" to be "Succeeded or Failed" Jan 21 18:46:34.107: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 35.626017ms Jan 21 18:46:36.143: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.07156977s Jan 21 18:46:38.179: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.108357742s Jan 21 18:46:40.224: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 6.152395719s Jan 21 18:46:42.260: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 8.18898498s Jan 21 18:46:44.296: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 10.225159952s Jan 21 18:46:46.335: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 12.264296008s Jan 21 18:46:48.371: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 14.300291986s Jan 21 18:46:50.412: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 16.340977163s Jan 21 18:46:52.471: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 18.400319011s Jan 21 18:46:54.507: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 20.436343001s Jan 21 18:46:56.543: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 22.472364124s Jan 21 18:46:58.579: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 24.50832442s Jan 21 18:47:00.616: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 26.544716238s Jan 21 18:47:02.652: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 28.580930725s Jan 21 18:47:04.688: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 30.617039087s Jan 21 18:47:06.735: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 32.663681483s Jan 21 18:47:08.771: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 34.699930502s Jan 21 18:47:10.808: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 36.73642085s Jan 21 18:47:12.843: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 38.772274257s Jan 21 18:47:14.880: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 40.809075246s Jan 21 18:47:16.916: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 42.844988306s Jan 21 18:47:18.954: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 44.882397772s Jan 21 18:47:20.995: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 46.923751934s Jan 21 18:47:23.031: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 48.959980447s Jan 21 18:47:25.067: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 50.995748593s Jan 21 18:47:27.102: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 53.031370452s Jan 21 18:47:29.138: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 55.067375878s Jan 21 18:47:31.174: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 57.103308057s Jan 21 18:47:33.210: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 59.13933567s Jan 21 18:47:35.249: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.177901685s Jan 21 18:47:37.285: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.214386752s Jan 21 18:47:39.322: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.250496372s Jan 21 18:47:41.358: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.287165892s Jan 21 18:47:43.395: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.323390897s Jan 21 18:47:45.431: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.359674464s Jan 21 18:47:47.467: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.395767746s Jan 21 18:47:49.503: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.432064191s Jan 21 18:47:51.539: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.467631165s Jan 21 18:47:53.575: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Running", Reason="", readiness=true. Elapsed: 1m19.503492643s Jan 21 18:47:55.611: INFO: Pod "pvc-snapshottable-tester-n7tdt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m21.539665805s �[1mSTEP�[0m: Saw pod success Jan 21 18:47:55.611: INFO: Pod "pvc-snapshottable-tester-n7tdt" satisfied condition "Succeeded or Failed" Jan 21 18:47:55.986: INFO: Pod pvc-snapshottable-tester-n7tdt has the following logs: Jan 21 18:47:55.986: INFO: Deleting pod "pvc-snapshottable-tester-n7tdt" in namespace "snapshotting-4174" Jan 21 18:47:56.031: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-n7tdt" to be fully deleted Jan 21 18:47:56.067: INFO: Waiting up to 5m0s for PersistentVolumeClaims [csi-gcepd-sc-windows98gq7] to have phase Bound Jan 21 18:47:56.103: INFO: PersistentVolumeClaim csi-gcepd-sc-windows98gq7 found and phase=Bound (36.176434ms) �[1mSTEP�[0m: checking the claim �[1mSTEP�[0m: checking the PV [BeforeEach] /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:190 �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jan 21 18:47:56.298: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-mskj6 to become ready Jan 21 18:47:56.354: INFO: VolumeSnapshot snapshot-mskj6 found but is not ready. Jan 21 18:47:58.390: INFO: VolumeSnapshot snapshot-mskj6 found but is not ready. Jan 21 18:48:00.427: INFO: VolumeSnapshot snapshot-mskj6 found but is not ready. Jan 21 18:48:02.464: INFO: VolumeSnapshot snapshot-mskj6 found but is not ready. Jan 21 18:48:04.501: INFO: VolumeSnapshot snapshot-mskj6 found but is not ready. Jan 21 18:48:06.538: INFO: VolumeSnapshot snapshot-mskj6 found but is not ready. Jan 21 18:48:08.575: INFO: VolumeSnapshot snapshot-mskj6 found but is not ready. Jan 21 18:48:10.614: INFO: VolumeSnapshot snapshot-mskj6 found but is not ready. Jan 21 18:48:12.741: INFO: VolumeSnapshot snapshot-mskj6 found but is not ready. Jan 21 18:48:14.777: INFO: VolumeSnapshot snapshot-mskj6 found but is not ready. Jan 21 18:48:16.822: INFO: VolumeSnapshot snapshot-mskj6 found and is ready Jan 21 18:48:16.822: INFO: WaitUntil finished successfully after 20.524629993s Jan 21 18:48:16.862: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-1b952655-6459-4574-85a8-745d13e2535f creationTime:2021-01-21T18:47:57Z readyToUse:true restoreSize:5Gi] Jan 21 18:48:16.862: INFO: snapshotContentName snapcontent-1b952655-6459-4574-85a8-745d13e2535f �[1mSTEP�[0m: updating the snapshot content deletion policy to retain �[1mSTEP�[0m: recording the volume handle and snapshotHandle Jan 21 18:48:16.937: INFO: Recording snapshot handle: projects/k8s-boskos-gce-project-19/global/snapshots/snapshot-1b952655-6459-4574-85a8-745d13e2535f �[1mSTEP�[0m: deleting the snapshot and snapshot content �[1mSTEP�[0m: checking the Snapshot has been deleted Jan 21 18:48:16.978: INFO: Waiting up to 5m0s for volumesnapshots snapshotting-4174 to be deleted Jan 21 18:48:17.020: INFO: volumesnapshots snapshotting-4174 is not found in namespace snapshot-mskj6 and has been deleted Jan 21 18:48:17.020: INFO: WaitUntil finished successfully after 42.031604ms �[1mSTEP�[0m: checking the Snapshot content has been deleted Jan 21 18:48:17.061: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-1b952655-6459-4574-85a8-745d13e2535f to be deleted Jan 21 18:48:17.097: INFO: volumesnapshotcontents snapcontent-1b952655-6459-4574-85a8-745d13e2535f has been found and is not deleted Jan 21 18:48:19.133: INFO: volumesnapshotcontents snapcontent-1b952655-6459-4574-85a8-745d13e2535f is not found and has been deleted Jan 21 18:48:19.133: INFO: WaitUntil finished successfully after 2.072378767s �[1mSTEP�[0m: creating a snapshot content with the snapshot handle �[1mSTEP�[0m: creating a snapshot with that snapshot content Jan 21 18:48:19.228: INFO: Waiting up to 5m0s for VolumeSnapshot pre-provisioned-snapshot-37894ba4-1630-4355-b3cd-30d21ac4e036 to become ready Jan 21 18:48:19.264: INFO: VolumeSnapshot pre-provisioned-snapshot-37894ba4-1630-4355-b3cd-30d21ac4e036 found but is not ready. Jan 21 18:48:21.319: INFO: VolumeSnapshot pre-provisioned-snapshot-37894ba4-1630-4355-b3cd-30d21ac4e036 found and is ready Jan 21 18:48:21.319: INFO: WaitUntil finished successfully after 2.090776376s �[1mSTEP�[0m: getting the snapshot and snapshot content [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: Modifying source data test �[1mSTEP�[0m: modifying the data in the source PVC Jan 21 18:48:21.522: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-92z9j" in namespace "snapshotting-4174" to be "Succeeded or Failed" Jan 21 18:48:21.589: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 66.73314ms Jan 21 18:48:23.625: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 2.102408478s Jan 21 18:48:25.661: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 4.138622003s Jan 21 18:48:27.697: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 6.174528044s Jan 21 18:48:29.733: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 8.210535179s Jan 21 18:48:31.769: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 10.246559566s Jan 21 18:48:33.808: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 12.28533557s Jan 21 18:48:35.844: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 14.321545745s Jan 21 18:48:37.880: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 16.357481575s Jan 21 18:48:39.916: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 18.393535284s Jan 21 18:48:41.962: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 20.439514016s Jan 21 18:48:43.998: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 22.47591419s Jan 21 18:48:46.034: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 24.512038623s Jan 21 18:48:48.070: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 26.548153488s Jan 21 18:48:50.107: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 28.584312102s Jan 21 18:48:52.143: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 30.620994039s Jan 21 18:48:54.179: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 32.656769597s Jan 21 18:48:56.230: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 34.707549539s Jan 21 18:48:58.266: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 36.743371484s Jan 21 18:49:00.302: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 38.77954756s Jan 21 18:49:02.339: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 40.816942381s Jan 21 18:49:04.375: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 42.853151566s Jan 21 18:49:06.413: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 44.890608089s Jan 21 18:49:08.449: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 46.926375539s Jan 21 18:49:10.488: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 48.965268945s Jan 21 18:49:12.523: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 51.001099665s Jan 21 18:49:14.559: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 53.036959709s Jan 21 18:49:16.598: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 55.076137517s Jan 21 18:49:18.634: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 57.112097158s Jan 21 18:49:20.670: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 59.147850899s Jan 21 18:49:22.706: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.183927106s Jan 21 18:49:24.747: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.224993631s Jan 21 18:49:26.783: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.260739209s Jan 21 18:49:28.822: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.299601598s Jan 21 18:49:30.860: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.338151719s Jan 21 18:49:32.896: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.373874328s Jan 21 18:49:34.937: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.414294055s Jan 21 18:49:36.973: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.450670201s Jan 21 18:49:39.010: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.487580223s Jan 21 18:49:41.046: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.523673053s Jan 21 18:49:43.084: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.561335738s Jan 21 18:49:45.121: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.599135816s Jan 21 18:49:47.164: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.642200121s Jan 21 18:49:49.202: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.680238896s Jan 21 18:49:51.244: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.721393298s Jan 21 18:49:53.287: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.764498359s Jan 21 18:49:55.326: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.803839375s Jan 21 18:49:57.364: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m35.841439615s Jan 21 18:49:59.400: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.878027899s Jan 21 18:50:01.437: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m39.914855966s Jan 21 18:50:03.473: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m41.951177433s Jan 21 18:50:05.510: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m43.988061999s Jan 21 18:50:07.547: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.024832798s Jan 21 18:50:09.583: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.061109843s Jan 21 18:50:11.621: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.098985794s Jan 21 18:50:13.657: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.135223747s Jan 21 18:50:15.709: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.187163852s Jan 21 18:50:17.746: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.224182876s Jan 21 18:50:19.783: INFO: Pod "pvc-snapshottable-data-tester-92z9j": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m58.260871918s �[1mSTEP�[0m: Saw pod success Jan 21 18:50:19.783: INFO: Pod "pvc-snapshottable-data-tester-92z9j" satisfied condition "Succeeded or Failed" Jan 21 18:50:19.966: INFO: Pod pvc-snapshottable-data-tester-92z9j has the following logs: Jan 21 18:50:19.967: INFO: Deleting pod "pvc-snapshottable-data-tester-92z9j" in namespace "snapshotting-4174" Jan 21 18:50:20.027: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-92z9j" to be fully deleted �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the claim Jan 21 18:51:46.230: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4174 exec restored-pvc-tester-smhw7 --namespace=snapshotting-4174 -- powershell /c type /mnt/test/data' Jan 21 18:51:51.597: INFO: stderr: "" Jan 21 18:51:51.597: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:53.597: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4174 exec restored-pvc-tester-smhw7 --namespace=snapshotting-4174 -- powershell /c type /mnt/test/data' Jan 21 18:51:56.447: INFO: stderr: "" Jan 21 18:51:56.447: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:51:58.447: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4174 exec restored-pvc-tester-smhw7 --namespace=snapshotting-4174 -- powershell /c type /mnt/test/data' Jan 21 18:52:01.385: INFO: stderr: "" Jan 21 18:52:01.385: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:52:03.385: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4174 exec restored-pvc-tester-smhw7 --namespace=snapshotting-4174 -- powershell /c type /mnt/test/data' Jan 21 18:52:06.537: INFO: stderr: "" Jan 21 18:52:06.537: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:52:08.538: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4174 exec restored-pvc-tester-smhw7 --namespace=snapshotting-4174 -- powershell /c type /mnt/test/data' Jan 21 18:52:12.972: INFO: stderr: "" Jan 21 18:52:12.972: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:52:14.973: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4174 exec restored-pvc-tester-smhw7 --namespace=snapshotting-4174 -- powershell /c type /mnt/test/data' Jan 21 18:52:19.145: INFO: stderr: "" Jan 21 18:52:19.145: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:52:21.145: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4174 exec restored-pvc-tester-smhw7 --namespace=snapshotting-4174 -- powershell /c type /mnt/test/data' Jan 21 18:52:26.553: INFO: stderr: "" Jan 21 18:52:26.553: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:52:28.554: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4174 exec restored-pvc-tester-smhw7 --namespace=snapshotting-4174 -- powershell /c type /mnt/test/data' Jan 21 18:52:35.083: INFO: stderr: "" Jan 21 18:52:35.083: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:52:37.083: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4174 exec restored-pvc-tester-smhw7 --namespace=snapshotting-4174 -- powershell /c type /mnt/test/data' Jan 21 18:52:40.573: INFO: stderr: "" Jan 21 18:52:40.574: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:52:42.574: INFO: Running '/tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/bin/kubectl --server=https://104.198.7.44 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4174 exec restored-pvc-tester-smhw7 --namespace=snapshotting-4174 -- powershell /c type /mnt/test/data' Jan 21 18:52:46.180: INFO: stderr: "" Jan 21 18:52:46.180: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 21 18:52:48.180: FAIL: Unexpected error: <*errors.errorString | 0xc003ef8070>: { s: "Failed to find \"hello from snapshotting-4174 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-4174 namespace", last result: "���������������������������������������� " occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.5.2() /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268 +0x1254 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001228d80) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc001228d80) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc001228d80, 0x4ff25a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] volume snapshot controller /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:179 Jan 21 18:52:48.776: INFO: Pod restored-pvc-tester-smhw7 has the following logs: Jan 21 18:52:48.776: INFO: Deleting pod "restored-pvc-tester-smhw7" in namespace "snapshotting-4174" Jan 21 18:52:48.816: INFO: Wait up to 5m0s for pod "restored-pvc-tester-smhw7" to be fully deleted Jan 21 18:53:10.887: INFO: deleting claim "snapshotting-4174"/"pvc-h8dck" Jan 21 18:53:10.925: INFO: deleting snapshot "snapshotting-4174"/"pre-provisioned-snapshot-37894ba4-1630-4355-b3cd-30d21ac4e036" Jan 21 18:53:10.971: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:pre-provisioned-snapcontent-37894ba4-1630-4355-b3cd-30d21ac4e036 creationTime:2021-01-21T18:47:57Z readyToUse:true restoreSize:5Gi] Jan 21 18:53:10.971: INFO: snapshotContentName pre-provisioned-snapcontent-37894ba4-1630-4355-b3cd-30d21ac4e036 Jan 21 18:53:11.089: INFO: Waiting up to 5m0s for volumesnapshotcontents pre-provisioned-snapcontent-37894ba4-1630-4355-b3cd-30d21ac4e036 to be deleted Jan 21 18:53:11.127: INFO: volumesnapshotcontents pre-provisioned-snapcontent-37894ba4-1630-4355-b3cd-30d21ac4e036 has been found and is not deleted Jan 21 18:53:13.224: INFO: volumesnapshotcontents pre-provisioned-snapcontent-37894ba4-1630-4355-b3cd-30d21ac4e036 has been found and is not deleted Jan 21 18:53:15.265: INFO: volumesnapshotcontents pre-provisioned-snapcontent-37894ba4-1630-4355-b3cd-30d21ac4e036 has been found and is not deleted Jan 21 18:53:17.302: INFO: volumesnapshotcontents pre-provisioned-snapcontent-37894ba4-1630-4355-b3cd-30d21ac4e036 has been found and is not deleted Jan 21 18:53:19.338: INFO: volumesnapshotcontents pre-provisioned-snapcontent-37894ba4-1630-4355-b3cd-30d21ac4e036 is not found and has been deleted Jan 21 18:53:19.338: INFO: WaitUntil finished successfully after 8.249452288s Jan 21 18:53:19.338: INFO: deleting snapshot content "pre-provisioned-snapcontent-37894ba4-1630-4355-b3cd-30d21ac4e036" Jan 21 18:53:19.374: INFO: deleting snapshot class "snapshotting-4174-vscszwfb" Jan 21 18:53:19.414: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-4174-vscszwfb to be deleted Jan 21 18:53:19.450: INFO: volumesnapshotclasses snapshotting-4174-vscszwfb is not found and has been deleted Jan 21 18:53:19.450: INFO: WaitUntil finished successfully after 35.387135ms �[1mSTEP�[0m: Deleting pvc Jan 21 18:53:19.524: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windows98gq7" Jan 21 18:53:19.562: INFO: Waiting up to 5m0s for PersistentVolume pvc-6f277e00-20ca-4924-a9e8-868cfb5a8813 to get deleted Jan 21 18:53:19.619: INFO: PersistentVolume pvc-6f277e00-20ca-4924-a9e8-868cfb5a8813 found and phase=Bound (56.546219ms) Jan 21 18:53:24.655: INFO: PersistentVolume pvc-6f277e00-20ca-4924-a9e8-868cfb5a8813 was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp434095652/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-4174". �[1mSTEP�[0m: Found 27 events. Jan 21 18:53:24.730: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-data-tester-92z9j: { } Scheduled: Successfully assigned snapshotting-4174/pvc-snapshottable-data-tester-92z9j to e2e-92e2afceff-9cdc3-windows-node-group-pgws Jan 21 18:53:24.730: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-tester-n7tdt: { } Scheduled: Successfully assigned snapshotting-4174/pvc-snapshottable-tester-n7tdt to e2e-92e2afceff-9cdc3-windows-node-group-099x Jan 21 18:53:24.730: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for restored-pvc-tester-smhw7: { } Scheduled: Successfully assigned snapshotting-4174/restored-pvc-tester-smhw7 to e2e-92e2afceff-9cdc3-windows-node-group-099x Jan 21 18:53:24.730: INFO: At 2021-01-21 18:46:33 +0000 UTC - event for csi-gcepd-sc-windows98gq7: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 21 18:53:24.730: INFO: At 2021-01-21 18:46:34 +0000 UTC - event for csi-gcepd-sc-windows98gq7: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 21 18:53:24.730: INFO: At 2021-01-21 18:46:34 +0000 UTC - event for csi-gcepd-sc-windows98gq7: {pd.csi.storage.gke.io_e2e-92e2afceff-9cdc3-minion-group-c8gb_32631f8a-44bf-4822-a433-c3a5da6f0587 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-4174/csi-gcepd-sc-windows98gq7" Jan 21 18:53:24.730: INFO: At 2021-01-21 18:46:38 +0000 UTC - event for csi-gcepd-sc-windows98gq7: {pd.csi.storage.gke.io_e2e-92e2afceff-9cdc3-minion-group-c8gb_32631f8a-44bf-4822-a433-c3a5da6f0587 } ProvisioningSucceeded: Successfully provisioned volume pvc-6f277e00-20ca-4924-a9e8-868cfb5a8813 Jan 21 18:53:24.730: INFO: At 2021-01-21 18:46:51 +0000 UTC - event for pvc-snapshottable-tester-n7tdt: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-6f277e00-20ca-4924-a9e8-868cfb5a8813" Jan 21 18:53:24.730: INFO: At 2021-01-21 18:47:45 +0000 UTC - event for pvc-snapshottable-tester-n7tdt: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-099x} Created: Created container volume-tester Jan 21 18:53:24.730: INFO: At 2021-01-21 18:47:45 +0000 UTC - event for pvc-snapshottable-tester-n7tdt: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-099x} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 21 18:53:24.730: INFO: At 2021-01-21 18:47:48 +0000 UTC - event for pvc-snapshottable-tester-n7tdt: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-099x} Started: Started container volume-tester Jan 21 18:53:24.730: INFO: At 2021-01-21 18:47:56 +0000 UTC - event for snapshot-mskj6: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-4174/snapshot-mskj6 to be created by the CSI driver. Jan 21 18:53:24.730: INFO: At 2021-01-21 18:48:19 +0000 UTC - event for pre-provisioned-snapshot-37894ba4-1630-4355-b3cd-30d21ac4e036: {snapshot-controller } SnapshotBindFailed: Snapshot failed to bind VolumeSnapshotContent, Operation cannot be fulfilled on volumesnapshotcontents.snapshot.storage.k8s.io "pre-provisioned-snapcontent-37894ba4-1630-4355-b3cd-30d21ac4e036": the object has been modified; please apply your changes to the latest version and try again Jan 21 18:53:24.730: INFO: At 2021-01-21 18:48:21 +0000 UTC - event for pvc-snapshottable-data-tester-92z9j: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-6f277e00-20ca-4924-a9e8-868cfb5a8813" Volume is already exclusively attached to one node and can't be attached to another Jan 21 18:53:24.730: INFO: At 2021-01-21 18:48:53 +0000 UTC - event for pvc-snapshottable-data-tester-92z9j: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-6f277e00-20ca-4924-a9e8-868cfb5a8813" Jan 21 18:53:24.730: INFO: At 2021-01-21 18:50:06 +0000 UTC - event for pvc-snapshottable-data-tester-92z9j: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-pgws} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 21 18:53:24.730: INFO: At 2021-01-21 18:50:06 +0000 UTC - event for pvc-snapshottable-data-tester-92z9j: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-pgws} Created: Created container volume-tester Jan 21 18:53:24.730: INFO: At 2021-01-21 18:50:09 +0000 UTC - event for pvc-snapshottable-data-tester-92z9j: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-pgws} Started: Started container volume-tester Jan 21 18:53:24.730: INFO: At 2021-01-21 18:50:20 +0000 UTC - event for pvc-h8dck: {pd.csi.storage.gke.io_e2e-92e2afceff-9cdc3-minion-group-c8gb_32631f8a-44bf-4822-a433-c3a5da6f0587 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-4174/pvc-h8dck" Jan 21 18:53:24.730: INFO: At 2021-01-21 18:50:20 +0000 UTC - event for pvc-h8dck: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 21 18:53:24.730: INFO: At 2021-01-21 18:50:20 +0000 UTC - event for pvc-h8dck: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 21 18:53:24.730: INFO: At 2021-01-21 18:50:42 +0000 UTC - event for pvc-h8dck: {pd.csi.storage.gke.io_e2e-92e2afceff-9cdc3-minion-group-c8gb_32631f8a-44bf-4822-a433-c3a5da6f0587 } ProvisioningSucceeded: Successfully provisioned volume pvc-4fcf5a69-8705-4fea-80b2-c49eec4644d6 Jan 21 18:53:24.730: INFO: At 2021-01-21 18:50:55 +0000 UTC - event for restored-pvc-tester-smhw7: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-4fcf5a69-8705-4fea-80b2-c49eec4644d6" Jan 21 18:53:24.730: INFO: At 2021-01-21 18:51:32 +0000 UTC - event for restored-pvc-tester-smhw7: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-099x} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 21 18:53:24.730: INFO: At 2021-01-21 18:51:32 +0000 UTC - event for restored-pvc-tester-smhw7: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-099x} Created: Created container volume-tester Jan 21 18:53:24.730: INFO: At 2021-01-21 18:51:35 +0000 UTC - event for restored-pvc-tester-smhw7: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-099x} Started: Started container volume-tester Jan 21 18:53:24.730: INFO: At 2021-01-21 18:52:49 +0000 UTC - event for restored-pvc-tester-smhw7: {kubelet e2e-92e2afceff-9cdc3-windows-node-group-099x} Killing: Stopping container volume-tester Jan 21 18:53:24.767: INFO: POD NODE PHASE GRACE CONDITIONS Jan 21 18:53:24.767: INFO: Jan 21 18:53:24.808: INFO: Logging node info for node e2e-92e2afceff-9cdc3-master Jan 21 18:53:24.845: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-master 7be0f5a4-3bf2-41f4-a4a2-bd4881522cda 9032 0 2021-01-21 18:07:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-21 18:07:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2021-01-21 18:37:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-21 18:41:36 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3866853376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3604709376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:07:16 +0000 UTC,LastTransitionTime:2021-01-21 18:07:16 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:104.198.7.44,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-master.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-master.c.k8s-boskos-gce-project-19.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:17278a3690a17ad962a99cffc578e964,SystemUUID:17278a36-90a1-7ad9-62a9-9cffc578e964,BootID:a1c3cec6-5edf-4c6c-bcee-d88ace424b19,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.21.0-alpha.1.224_ded5726227fbdb],SizeBytes:123001134,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.21.0-alpha.1.224_ded5726227fbdb],SizeBytes:117520714,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:70314486,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.21.0-alpha.1.224_ded5726227fbdb],SizeBytes:47716663,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 21 18:53:24.845: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-master Jan 21 18:53:24.882: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-master Jan 21 18:53:24.932: INFO: kube-addon-manager-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:06:51 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:24.932: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 21 18:53:24.932: INFO: l7-lb-controller-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:07:01 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:24.932: INFO: Container l7-lb-controller ready: true, restart count 0 Jan 21 18:53:24.932: INFO: csi-gce-pd-node-q5d7p started at 2021-01-21 18:37:00 +0000 UTC (0+2 container statuses recorded) Jan 21 18:53:24.932: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 18:53:24.932: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 18:53:24.932: INFO: etcd-server-events-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:05:55 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:24.932: INFO: Container etcd-container ready: true, restart count 0 Jan 21 18:53:24.932: INFO: etcd-server-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:06:05 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:24.932: INFO: Container etcd-container ready: true, restart count 0 Jan 21 18:53:24.932: INFO: kube-scheduler-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:06:35 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:24.932: INFO: Container kube-scheduler ready: true, restart count 0 Jan 21 18:53:24.932: INFO: metadata-proxy-v0.1-j6fg6 started at 2021-01-21 18:07:35 +0000 UTC (0+2 container statuses recorded) Jan 21 18:53:24.932: INFO: Container metadata-proxy ready: true, restart count 0 Jan 21 18:53:24.932: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 21 18:53:24.932: INFO: kube-apiserver-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:06:15 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:24.932: INFO: Container kube-apiserver ready: true, restart count 0 Jan 21 18:53:24.932: INFO: kube-controller-manager-e2e-92e2afceff-9cdc3-master started at 2021-01-21 18:06:25 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:24.932: INFO: Container kube-controller-manager ready: true, restart count 0 W0121 18:53:24.980680 68816 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:53:25.400: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-master Jan 21 18:53:25.401: INFO: Logging node info for node e2e-92e2afceff-9cdc3-minion-group-c8gb Jan 21 18:53:25.439: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-minion-group-c8gb 14bc41b1-d9b1-4e9a-999d-1762d91dce7a 9030 0 2021-01-21 18:07:23 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-minion-group-c8gb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-minion-group-c8gb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-21 18:07:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-21 18:07:28 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-21 18:37:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-21 18:41:36 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-minion-group-c8gb,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-21 18:52:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-21 18:52:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-21 18:52:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-21 18:52:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-21 18:52:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-21 18:52:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-21 18:52:31 +0000 UTC,LastTransitionTime:2021-01-21 18:07:27 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:07:23 +0000 UTC,LastTransitionTime:2021-01-21 18:07:23 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.24.255,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-minion-group-c8gb.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-minion-group-c8gb.c.k8s-boskos-gce-project-19.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:42dd67036582d457d9babc45a4667de4,SystemUUID:42dd6703-6582-d457-d9ba-bc45a4667de4,BootID:de7b2e6e-bff1-431c-9854-67870cf0dee8,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.224_ded5726227fbdb],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:70314486,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:bec571992d40203edcd056ac0b0d97003887ee5e4be144c41932d18639673b03 k8s.gcr.io/sig-storage/csi-provisioner:v2.0.4],SizeBytes:20428748,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:e5ce22ddc2a6fbc9b5729dbcfaf1159c4b0d48dad62ddd1b93503c1348e4a406 k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.1],SizeBytes:19498883,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:ca160717df7f6b7964c936faf608b914f2277363e6d708ea2e2dbbf2c5f56a83 k8s.gcr.io/sig-storage/csi-resizer:v1.0.1],SizeBytes:19463877,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:7495d30800fb3ef22f3dc6d5fe9a0a6ec40ba32a2bdc0cf5e7fcaa507adc921e k8s.gcr.io/sig-storage/csi-attacher:v3.0.1],SizeBytes:19460260,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 21 18:53:25.439: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-minion-group-c8gb Jan 21 18:53:25.484: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-minion-group-c8gb Jan 21 18:53:25.531: INFO: kube-dns-autoscaler-76478fcf46-hbkx5 started at 2021-01-21 18:07:33 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:25.531: INFO: Container autoscaler ready: true, restart count 0 Jan 21 18:53:25.531: INFO: l7-default-backend-6dd8477499-fp2vv started at 2021-01-21 18:07:34 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:25.531: INFO: Container default-http-backend ready: true, restart count 0 Jan 21 18:53:25.531: INFO: coredns-6954c77b9b-5p2c9 started at 2021-01-21 18:07:36 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:25.531: INFO: Container coredns ready: true, restart count 0 Jan 21 18:53:25.531: INFO: csi-gce-pd-controller-59f869d4f8-ch6pq started at 2021-01-21 18:37:00 +0000 UTC (0+5 container statuses recorded) Jan 21 18:53:25.531: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 18:53:25.531: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 18:53:25.531: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 18:53:25.531: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 18:53:25.531: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 18:53:25.531: INFO: metrics-server-v0.3.6-8b98f98c9-mjgkx started at 2021-01-21 18:08:07 +0000 UTC (0+2 container statuses recorded) Jan 21 18:53:25.531: INFO: Container metrics-server ready: true, restart count 0 Jan 21 18:53:25.531: INFO: Container metrics-server-nanny ready: true, restart count 0 Jan 21 18:53:25.531: INFO: csi-gce-pd-node-wnc2q started at 2021-01-21 18:37:00 +0000 UTC (0+2 container statuses recorded) Jan 21 18:53:25.531: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 18:53:25.531: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 18:53:25.531: INFO: kube-proxy-e2e-92e2afceff-9cdc3-minion-group-c8gb started at 2021-01-21 18:07:22 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:25.531: INFO: Container kube-proxy ready: true, restart count 0 Jan 21 18:53:25.531: INFO: metadata-proxy-v0.1-6k6bx started at 2021-01-21 18:07:23 +0000 UTC (0+2 container statuses recorded) Jan 21 18:53:25.531: INFO: Container metadata-proxy ready: true, restart count 0 Jan 21 18:53:25.531: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 W0121 18:53:25.578971 68816 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:53:25.812: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-minion-group-c8gb Jan 21 18:53:25.812: INFO: Logging node info for node e2e-92e2afceff-9cdc3-minion-group-gsrb Jan 21 18:53:25.850: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-minion-group-gsrb 93e3ee37-2ba2-4475-bd9c-c558034d35af 9031 0 2021-01-21 18:07:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-minion-group-gsrb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-minion-group-gsrb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-21 18:07:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.5.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-21 18:07:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-21 18:37:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-21 18:41:36 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.5.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-minion-group-gsrb,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.5.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-21 18:52:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-21 18:52:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-21 18:52:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-21 18:52:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-21 18:52:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-21 18:52:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-21 18:52:30 +0000 UTC,LastTransitionTime:2021-01-21 18:07:25 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:07:23 +0000 UTC,LastTransitionTime:2021-01-21 18:07:23 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:23 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:23 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:23 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:52:32 +0000 UTC,LastTransitionTime:2021-01-21 18:07:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.7,},NodeAddress{Type:ExternalIP,Address:34.82.29.73,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-minion-group-gsrb.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-minion-group-gsrb.c.k8s-boskos-gce-project-19.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:62a1a3950cce8cc6e9c6d37bac3f10ad,SystemUUID:62a1a395-0cce-8cc6-e9c6-d37bac3f10ad,BootID:4d229fc6-5a17-409c-b10d-6e37c5845745,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.224_ded5726227fbdb],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:70314486,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:a494ff6ec10e05a454458fbf44247d93c9b3a0d983a00b538e442f353b7030c8 k8s.gcr.io/sig-storage/snapshot-controller:v3.0.2],SizeBytes:17461280,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 21 18:53:25.850: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-minion-group-gsrb Jan 21 18:53:25.888: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-minion-group-gsrb Jan 21 18:53:25.929: INFO: kube-proxy-e2e-92e2afceff-9cdc3-minion-group-gsrb started at 2021-01-21 18:07:23 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:25.929: INFO: Container kube-proxy ready: true, restart count 0 Jan 21 18:53:25.929: INFO: metadata-proxy-v0.1-2k99q started at 2021-01-21 18:07:23 +0000 UTC (0+2 container statuses recorded) Jan 21 18:53:25.929: INFO: Container metadata-proxy ready: true, restart count 0 Jan 21 18:53:25.929: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 21 18:53:25.929: INFO: volume-snapshot-controller-0 started at 2021-01-21 18:07:33 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:25.929: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jan 21 18:53:25.929: INFO: csi-gce-pd-node-vbbp4 started at 2021-01-21 18:37:00 +0000 UTC (0+2 container statuses recorded) Jan 21 18:53:25.929: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 18:53:25.929: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 18:53:25.929: INFO: coredns-6954c77b9b-5xnq4 started at 2021-01-21 18:07:41 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:25.929: INFO: Container coredns ready: true, restart count 0 W0121 18:53:25.970037 68816 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:53:26.162: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-minion-group-gsrb Jan 21 18:53:26.163: INFO: Logging node info for node e2e-92e2afceff-9cdc3-windows-node-group-099x Jan 21 18:53:26.199: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-windows-node-group-099x 8ebd0400-36b4-426c-ad95-00672f6e8a05 9324 0 2021-01-21 18:09:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-windows-node-group-099x kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-windows-node-group-099x"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-21 18:46:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-21 18:46:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-windows-node-group-099x,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:09:58 +0000 UTC,LastTransitionTime:2021-01-21 18:09:58 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:53:16 +0000 UTC,LastTransitionTime:2021-01-21 18:09:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:53:16 +0000 UTC,LastTransitionTime:2021-01-21 18:09:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:53:16 +0000 UTC,LastTransitionTime:2021-01-21 18:09:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:53:16 +0000 UTC,LastTransitionTime:2021-01-21 18:10:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.83.184.35,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-windows-node-group-099x.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-windows-node-group-099x,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-92e2afceff-9cdc3-windows-node-group-099x,SystemUUID:0DED9D31-AD1A-038B-7E10-151153FE50EA,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-4fcf5a69-8705-4fea-80b2-c49eec4644d6 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-f1bc320a-ac15-4631-8483-eb5085a36460],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-4fcf5a69-8705-4fea-80b2-c49eec4644d6,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-f1bc320a-ac15-4631-8483-eb5085a36460,DevicePath:,},},Config:nil,},} Jan 21 18:53:26.200: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-windows-node-group-099x Jan 21 18:53:26.257: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-windows-node-group-099x Jan 21 18:53:26.354: INFO: csi-gce-pd-node-win-xzr5l started at 2021-01-21 18:37:01 +0000 UTC (0+2 container statuses recorded) Jan 21 18:53:26.354: INFO: Container csi-driver-registrar ready: true, restart count 1 Jan 21 18:53:26.354: INFO: Container gce-pd-driver ready: true, restart count 0 W0121 18:53:26.399089 68816 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:53:27.687: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-windows-node-group-099x Jan 21 18:53:27.687: INFO: Logging node info for node e2e-92e2afceff-9cdc3-windows-node-group-pgws Jan 21 18:53:27.723: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-windows-node-group-pgws 446fc7c3-e45e-4731-834e-b50ec7dda462 9348 0 2021-01-21 18:09:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-windows-node-group-pgws kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-windows-node-group-pgws"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-21 18:42:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-21 18:42:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-windows-node-group-pgws,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:09:55 +0000 UTC,LastTransitionTime:2021-01-21 18:09:55 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:53:21 +0000 UTC,LastTransitionTime:2021-01-21 18:09:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:53:21 +0000 UTC,LastTransitionTime:2021-01-21 18:09:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:53:21 +0000 UTC,LastTransitionTime:2021-01-21 18:09:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:53:21 +0000 UTC,LastTransitionTime:2021-01-21 18:10:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:104.196.255.127,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-windows-node-group-pgws.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-windows-node-group-pgws,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-92e2afceff-9cdc3-windows-node-group-pgws,SystemUUID:8FD7163A-577B-1D7D-0B03-7AFFABCA3DFB,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-53fa8a8a-1440-4d5a-a483-dbf801a9345b kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-f301ce0c-1ffe-4266-ba51-710d12aa5a9a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-f301ce0c-1ffe-4266-ba51-710d12aa5a9a,DevicePath:,},},Config:nil,},} Jan 21 18:53:27.724: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-windows-node-group-pgws Jan 21 18:53:27.761: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-windows-node-group-pgws Jan 21 18:53:27.801: INFO: csi-gce-pd-node-win-drggr started at 2021-01-21 18:37:00 +0000 UTC (0+2 container statuses recorded) Jan 21 18:53:27.801: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 18:53:27.801: INFO: Container gce-pd-driver ready: true, restart count 1 Jan 21 18:53:27.801: INFO: pvc-snapshottable-data-tester-v5tqh started at 2021-01-21 18:53:08 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:27.801: INFO: Container volume-tester ready: false, restart count 0 Jan 21 18:53:27.801: INFO: pod-subpath-test-dynamicpv-pnrd started at 2021-01-21 18:50:08 +0000 UTC (1+2 container statuses recorded) Jan 21 18:53:27.801: INFO: Init container init-volume-dynamicpv-pnrd ready: true, restart count 0 Jan 21 18:53:27.801: INFO: Container test-container-subpath-dynamicpv-pnrd ready: true, restart count 2 Jan 21 18:53:27.801: INFO: Container test-container-volume-dynamicpv-pnrd ready: true, restart count 0 W0121 18:53:27.846561 68816 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:53:28.269: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-windows-node-group-pgws Jan 21 18:53:28.269: INFO: Logging node info for node e2e-92e2afceff-9cdc3-windows-node-group-z0ng Jan 21 18:53:28.309: INFO: Node Info: &Node{ObjectMeta:{e2e-92e2afceff-9cdc3-windows-node-group-z0ng fea1e475-2aa8-4e45-b125-332cf61ced06 9352 0 2021-01-21 18:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-92e2afceff-9cdc3-windows-node-group-z0ng kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-boskos-gce-project-19/zones/us-west1-b/instances/e2e-92e2afceff-9cdc3-windows-node-group-z0ng"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-21 18:42:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-21 18:45:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-19/us-west1-b/e2e-92e2afceff-9cdc3-windows-node-group-z0ng,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-21 18:09:42 +0000 UTC,LastTransitionTime:2021-01-21 18:09:42 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-21 18:53:21 +0000 UTC,LastTransitionTime:2021-01-21 18:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-21 18:53:21 +0000 UTC,LastTransitionTime:2021-01-21 18:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-21 18:53:21 +0000 UTC,LastTransitionTime:2021-01-21 18:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-21 18:53:21 +0000 UTC,LastTransitionTime:2021-01-21 18:09:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.105.57.214,},NodeAddress{Type:InternalDNS,Address:e2e-92e2afceff-9cdc3-windows-node-group-z0ng.c.k8s-boskos-gce-project-19.internal,},NodeAddress{Type:Hostname,Address:e2e-92e2afceff-9cdc3-windows-node-group-z0ng,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-92e2afceff-9cdc3-windows-node-group-z0ng,SystemUUID:B9239180-7AFD-487C-8A4F-3B2B72E8705D,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.224+ded5726227fbdb,KubeProxyVersion:v1.21.0-alpha.1.224+ded5726227fbdb,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver@sha256:6cb22065603b5219f015f904e8b6c7fb01554cb51abd1a5c5ea4e5acaecc50d4 gcr.io/k8s-boskos-gce-project-19/gcp-persistent-disk-csi-driver:01cb1522-21ec-4351-bea9-65e02f5fb73e],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-6ca254d7-d918-453a-b56c-1ab41cf1fdf6 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-8d1c9a57-6c42-4e97-8a9b-8631e7c45fa9 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-a35753f2-3a73-4116-9c85-acfa00ccec9e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-8d1c9a57-6c42-4e97-8a9b-8631e7c45fa9,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-6ca254d7-d918-453a-b56c-1ab41cf1fdf6,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-boskos-gce-project-19/zones/us-west1-b/disks/pvc-a35753f2-3a73-4116-9c85-acfa00ccec9e,DevicePath:,},},Config:nil,},} Jan 21 18:53:28.309: INFO: Logging kubelet events for node e2e-92e2afceff-9cdc3-windows-node-group-z0ng Jan 21 18:53:28.347: INFO: Logging pods the kubelet thinks is on node e2e-92e2afceff-9cdc3-windows-node-group-z0ng Jan 21 18:53:28.499: INFO: csi-gce-pd-node-win-2zw4k started at 2021-01-21 18:37:01 +0000 UTC (0+2 container statuses recorded) Jan 21 18:53:28.499: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 18:53:28.499: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 18:53:28.499: INFO: pod-subpath-test-dynamicpv-24dt started at 2021-01-21 18:52:46 +0000 UTC (1+1 container statuses recorded) Jan 21 18:53:28.499: INFO: Init container init-volume-dynamicpv-24dt ready: false, restart count 0 Jan 21 18:53:28.499: INFO: Container test-container-subpath-dynamicpv-24dt ready: false, restart count 0 Jan 21 18:53:28.499: INFO: external-client started at 2021-01-21 18:53:06 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:28.499: INFO: Container external-client ready: false, restart count 0 Jan 21 18:53:28.499: INFO: pod-189b3e65-1348-4c71-a3f3-3e3290f46e53 started at 2021-01-21 18:53:12 +0000 UTC (0+1 container statuses recorded) Jan 21 18:53:28.499: INFO: Container write-pod ready: false, restart count 0 W0121 18:53:28.545197 68816 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 21 18:53:32.999: INFO: Latency metrics for node e2e-92e2afceff-9cdc3-windows-node-group-z0ng Jan 21 18:53:32.999: INFO: Waiting up to 3m0s for all (but 3) nodes to be ready �[1mSTEP�[0m: Destroying namespace "snapshotting-4174" for this suite.
Filter through log files | View test history on testgrid
Check APIReachability
Deferred TearDown
DumpClusterLogs
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion
Extract
TearDown
TearDown Previous
Timeout
Up
diffResources
list nodes
listResources After
listResources Before
listResources Down
listResources Up
test setup
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail in binding dynamic provisioned PV to PVC [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (delayed binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (immediate binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][sig-windows] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][sig-windows] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable-stress[Feature:VolumeSnapshotDataSource] should support snapshotting of many volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable-stress[Feature:VolumeSnapshotDataSource] should support snapshotting of many volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (xfs)][Slow] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to create pod by failing to mount volume [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should store data