ci-gce-pd-csi-driver-latest-k8s-master-windows-2019 #1352436327756337152
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 3 failed / 42 succeeded |
| Started | |
| Elapsed | 1h22m |
| Revision | master |
| job-version | v1.21.0-alpha.1.246+f8ca5ad18a2452 |
| revision | v1.21.0-alpha.1.246+f8ca5ad18a2452 |
error during /home/prow/go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver/test/run-windows-k8s-integration.sh: exit status 255
from junit_runner.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=External\sStorage\s\[Driver\:\scsi\-gcepd\-sc\-windows\]\s\[Testpattern\:\sDynamic\sSnapshot\s\(delete\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion$'
/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 Jan 22 03:09:43.686: Unexpected error: <*errors.errorString | 0xc002622760>: { s: "Failed to find \"hello from snapshotting-519 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-519 namespace", last result: "��������������������������������������� " occurred /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268from junit_pdcsi.xml
[BeforeEach] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 22 03:03:59.604: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] volume snapshot controller /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:176 Jan 22 03:03:59.781: INFO: Creating resource for dynamic PV Jan 22 03:03:59.781: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-519-e2e-scmcnlb �[1mSTEP�[0m: creating a claim Jan 22 03:03:59.818: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: starting a pod to use the claim Jan 22 03:03:59.928: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-qrtvj" in namespace "snapshotting-519" to be "Succeeded or Failed" Jan 22 03:03:59.964: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 35.842387ms Jan 22 03:04:02.000: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.072267537s Jan 22 03:04:04.036: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.108464064s Jan 22 03:04:06.071: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.143380208s Jan 22 03:04:08.108: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.179677317s Jan 22 03:04:10.143: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.215160781s Jan 22 03:04:12.181: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 12.253060458s Jan 22 03:04:14.218: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 14.28997742s Jan 22 03:04:16.253: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 16.325424207s Jan 22 03:04:18.290: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 18.362232523s Jan 22 03:04:20.328: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 20.400127597s Jan 22 03:04:22.364: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 22.435946176s Jan 22 03:04:24.400: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 24.471939095s Jan 22 03:04:26.436: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 26.507756431s Jan 22 03:04:28.472: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 28.543991645s Jan 22 03:04:30.507: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 30.579002506s Jan 22 03:04:32.542: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 32.614572862s Jan 22 03:04:34.578: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 34.650172122s Jan 22 03:04:36.614: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 36.686278269s Jan 22 03:04:38.650: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 38.722539734s Jan 22 03:04:40.686: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 40.758240698s Jan 22 03:04:42.722: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 42.793883087s Jan 22 03:04:44.757: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 44.829554737s Jan 22 03:04:46.806: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 46.877979469s Jan 22 03:04:48.841: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 48.913385807s Jan 22 03:04:50.877: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 50.94888878s Jan 22 03:04:52.912: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 52.984337986s Jan 22 03:04:54.948: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 55.020446517s Jan 22 03:04:56.985: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 57.056721216s Jan 22 03:04:59.021: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 59.092984095s Jan 22 03:05:01.057: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.12873175s Jan 22 03:05:03.092: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.164224404s Jan 22 03:05:05.128: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.199787165s Jan 22 03:05:07.163: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.235478715s Jan 22 03:05:09.199: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.270932124s Jan 22 03:05:11.234: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.306332786s Jan 22 03:05:13.270: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.342178851s Jan 22 03:05:15.305: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.377403456s Jan 22 03:05:17.341: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.412706902s Jan 22 03:05:19.377: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.448794298s Jan 22 03:05:21.412: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.4839179s Jan 22 03:05:23.447: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.519602064s Jan 22 03:05:25.483: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.555400004s Jan 22 03:05:27.519: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Running", Reason="", readiness=true. Elapsed: 1m27.591133061s Jan 22 03:05:29.556: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Running", Reason="", readiness=true. Elapsed: 1m29.62790383s Jan 22 03:05:31.592: INFO: Pod "pvc-snapshottable-tester-qrtvj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m31.664048373s �[1mSTEP�[0m: Saw pod success Jan 22 03:05:31.592: INFO: Pod "pvc-snapshottable-tester-qrtvj" satisfied condition "Succeeded or Failed" Jan 22 03:05:31.932: INFO: Pod pvc-snapshottable-tester-qrtvj has the following logs: Jan 22 03:05:31.932: INFO: Deleting pod "pvc-snapshottable-tester-qrtvj" in namespace "snapshotting-519" Jan 22 03:05:31.979: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-qrtvj" to be fully deleted Jan 22 03:05:32.014: INFO: Waiting up to 5m0s for PersistentVolumeClaims [csi-gcepd-sc-windowsz7smz] to have phase Bound Jan 22 03:05:32.050: INFO: PersistentVolumeClaim csi-gcepd-sc-windowsz7smz found and phase=Bound (35.39982ms) �[1mSTEP�[0m: checking the claim �[1mSTEP�[0m: checking the PV [BeforeEach] /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:190 �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jan 22 03:05:32.242: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-j8s7f to become ready Jan 22 03:05:32.285: INFO: VolumeSnapshot snapshot-j8s7f found but is not ready. Jan 22 03:05:34.321: INFO: VolumeSnapshot snapshot-j8s7f found but is not ready. Jan 22 03:05:36.357: INFO: VolumeSnapshot snapshot-j8s7f found but is not ready. Jan 22 03:05:38.394: INFO: VolumeSnapshot snapshot-j8s7f found but is not ready. Jan 22 03:05:40.430: INFO: VolumeSnapshot snapshot-j8s7f found but is not ready. Jan 22 03:05:42.467: INFO: VolumeSnapshot snapshot-j8s7f found but is not ready. Jan 22 03:05:44.503: INFO: VolumeSnapshot snapshot-j8s7f found but is not ready. Jan 22 03:05:46.539: INFO: VolumeSnapshot snapshot-j8s7f found but is not ready. Jan 22 03:05:48.576: INFO: VolumeSnapshot snapshot-j8s7f found but is not ready. Jan 22 03:05:50.612: INFO: VolumeSnapshot snapshot-j8s7f found and is ready Jan 22 03:05:50.612: INFO: WaitUntil finished successfully after 18.369906948s Jan 22 03:05:50.647: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-08d74482-1e6e-4251-8ea4-f0d2951aae7b creationTime:2021-01-22T03:05:34Z readyToUse:true restoreSize:5Gi] Jan 22 03:05:50.647: INFO: snapshotContentName snapcontent-08d74482-1e6e-4251-8ea4-f0d2951aae7b [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: Modifying source data test �[1mSTEP�[0m: modifying the data in the source PVC Jan 22 03:05:50.798: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-87bsp" in namespace "snapshotting-519" to be "Succeeded or Failed" Jan 22 03:05:50.833: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 35.119688ms Jan 22 03:05:52.869: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.070826515s Jan 22 03:05:54.904: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 4.106353815s Jan 22 03:05:56.940: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 6.141950203s Jan 22 03:05:58.977: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 8.179243869s Jan 22 03:06:01.013: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 10.215227818s Jan 22 03:06:03.049: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 12.251043877s Jan 22 03:06:05.085: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 14.286777655s Jan 22 03:06:07.120: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 16.322399833s Jan 22 03:06:09.156: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 18.357956945s Jan 22 03:06:11.192: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 20.394475938s Jan 22 03:06:13.234: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 22.436116478s Jan 22 03:06:15.270: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 24.472200536s Jan 22 03:06:17.306: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 26.507926566s Jan 22 03:06:19.341: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 28.543429375s Jan 22 03:06:21.377: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 30.579135714s Jan 22 03:06:23.413: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 32.615572935s Jan 22 03:06:25.451: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 34.652666763s Jan 22 03:06:27.487: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 36.688650523s Jan 22 03:06:29.522: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 38.724269373s Jan 22 03:06:31.558: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 40.759800121s Jan 22 03:06:33.594: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 42.796110527s Jan 22 03:06:35.630: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 44.831855587s Jan 22 03:06:37.665: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 46.867432379s Jan 22 03:06:39.701: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 48.902965076s Jan 22 03:06:41.737: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 50.939559933s Jan 22 03:06:43.779: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 52.980853932s Jan 22 03:06:45.814: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 55.016160944s Jan 22 03:06:47.851: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 57.052965025s Jan 22 03:06:49.887: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 59.089120265s Jan 22 03:06:51.924: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.125669182s Jan 22 03:06:53.959: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.161212198s Jan 22 03:06:55.995: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.196867137s Jan 22 03:06:58.031: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.232704034s Jan 22 03:07:00.067: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.268643641s Jan 22 03:07:02.102: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.304195135s Jan 22 03:07:04.156: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.358391815s Jan 22 03:07:06.193: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.39480381s Jan 22 03:07:08.228: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.430511409s Jan 22 03:07:10.264: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.46611309s Jan 22 03:07:12.300: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.502110251s Jan 22 03:07:14.336: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.537917623s Jan 22 03:07:16.371: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.57360251s Jan 22 03:07:18.409: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.611285854s Jan 22 03:07:20.445: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.647198411s Jan 22 03:07:22.483: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.684983729s Jan 22 03:07:24.518: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.720576229s Jan 22 03:07:26.560: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m35.762241094s Jan 22 03:07:28.599: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.801076179s Jan 22 03:07:30.635: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m39.836901902s Jan 22 03:07:32.670: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m41.872605292s Jan 22 03:07:34.706: INFO: Pod "pvc-snapshottable-data-tester-87bsp": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m43.908239177s �[1mSTEP�[0m: Saw pod success Jan 22 03:07:34.706: INFO: Pod "pvc-snapshottable-data-tester-87bsp" satisfied condition "Succeeded or Failed" Jan 22 03:07:34.839: INFO: Pod pvc-snapshottable-data-tester-87bsp has the following logs: Jan 22 03:07:34.839: INFO: Deleting pod "pvc-snapshottable-data-tester-87bsp" in namespace "snapshotting-519" Jan 22 03:07:34.882: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-87bsp" to be fully deleted �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the claim Jan 22 03:08:43.067: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:08:45.861: INFO: stderr: "" Jan 22 03:08:45.861: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:08:47.861: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:08:49.310: INFO: stderr: "" Jan 22 03:08:49.310: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:08:51.311: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:08:52.809: INFO: stderr: "" Jan 22 03:08:52.809: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:08:54.810: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:08:55.913: INFO: stderr: "" Jan 22 03:08:55.913: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:08:57.913: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:08:59.039: INFO: stderr: "" Jan 22 03:08:59.039: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:01.040: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:02.259: INFO: stderr: "" Jan 22 03:09:02.259: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:04.259: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:05.601: INFO: stderr: "" Jan 22 03:09:05.601: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:07.601: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:08.927: INFO: stderr: "" Jan 22 03:09:08.927: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:10.927: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:12.049: INFO: stderr: "" Jan 22 03:09:12.049: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:14.050: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:15.285: INFO: stderr: "" Jan 22 03:09:15.285: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:17.286: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:18.404: INFO: stderr: "" Jan 22 03:09:18.404: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:20.404: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:21.516: INFO: stderr: "" Jan 22 03:09:21.516: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:23.517: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:24.750: INFO: stderr: "" Jan 22 03:09:24.750: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:26.754: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:28.429: INFO: stderr: "" Jan 22 03:09:28.429: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:30.430: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:31.624: INFO: stderr: "" Jan 22 03:09:31.624: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:33.625: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:34.830: INFO: stderr: "" Jan 22 03:09:34.830: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:36.831: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:38.199: INFO: stderr: "" Jan 22 03:09:38.199: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:40.199: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-519 exec restored-pvc-tester-f6prk --namespace=snapshotting-519 -- powershell /c type /mnt/test/data' Jan 22 03:09:41.685: INFO: stderr: "" Jan 22 03:09:41.685: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:09:43.686: FAIL: Unexpected error: <*errors.errorString | 0xc002622760>: { s: "Failed to find \"hello from snapshotting-519 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-519 namespace", last result: "��������������������������������������� " occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.5.2() /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268 +0x1254 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000a78900) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000a78900) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc000a78900, 0x4ff25a8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] volume snapshot controller /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:179 Jan 22 03:09:43.749: INFO: Pod restored-pvc-tester-f6prk has the following logs: Jan 22 03:09:43.749: INFO: Deleting pod "restored-pvc-tester-f6prk" in namespace "snapshotting-519" Jan 22 03:09:43.813: INFO: Wait up to 5m0s for pod "restored-pvc-tester-f6prk" to be fully deleted Jan 22 03:09:47.885: INFO: deleting claim "snapshotting-519"/"pvc-fnzjl" Jan 22 03:09:47.923: INFO: deleting snapshot "snapshotting-519"/"snapshot-j8s7f" Jan 22 03:09:47.964: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-08d74482-1e6e-4251-8ea4-f0d2951aae7b creationTime:2021-01-22T03:05:34Z readyToUse:true restoreSize:5Gi] Jan 22 03:09:47.964: INFO: snapshotContentName snapcontent-08d74482-1e6e-4251-8ea4-f0d2951aae7b Jan 22 03:09:48.040: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-08d74482-1e6e-4251-8ea4-f0d2951aae7b to be deleted Jan 22 03:09:48.078: INFO: volumesnapshotcontents snapcontent-08d74482-1e6e-4251-8ea4-f0d2951aae7b has been found and is not deleted Jan 22 03:09:50.116: INFO: volumesnapshotcontents snapcontent-08d74482-1e6e-4251-8ea4-f0d2951aae7b has been found and is not deleted Jan 22 03:09:52.172: INFO: volumesnapshotcontents snapcontent-08d74482-1e6e-4251-8ea4-f0d2951aae7b has been found and is not deleted Jan 22 03:09:54.210: INFO: volumesnapshotcontents snapcontent-08d74482-1e6e-4251-8ea4-f0d2951aae7b has been found and is not deleted Jan 22 03:09:56.247: INFO: volumesnapshotcontents snapcontent-08d74482-1e6e-4251-8ea4-f0d2951aae7b is not found and has been deleted Jan 22 03:09:56.247: INFO: WaitUntil finished successfully after 8.206999992s Jan 22 03:09:56.247: INFO: deleting snapshot content "snapcontent-08d74482-1e6e-4251-8ea4-f0d2951aae7b" Jan 22 03:09:56.283: INFO: deleting snapshot class "snapshotting-519-vsckhcpb" Jan 22 03:09:56.323: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-519-vsckhcpb to be deleted Jan 22 03:09:56.359: INFO: volumesnapshotclasses snapshotting-519-vsckhcpb is not found and has been deleted Jan 22 03:09:56.359: INFO: WaitUntil finished successfully after 35.844044ms �[1mSTEP�[0m: Deleting pvc Jan 22 03:09:56.430: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windowsz7smz" Jan 22 03:09:56.468: INFO: Waiting up to 5m0s for PersistentVolume pvc-b8e4eea5-c434-463b-b612-63e9d1d8c4fc to get deleted Jan 22 03:09:56.503: INFO: PersistentVolume pvc-b8e4eea5-c434-463b-b612-63e9d1d8c4fc found and phase=Released (34.770482ms) Jan 22 03:10:01.539: INFO: PersistentVolume pvc-b8e4eea5-c434-463b-b612-63e9d1d8c4fc was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-519". �[1mSTEP�[0m: Found 26 events. Jan 22 03:10:01.626: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-data-tester-87bsp: { } Scheduled: Successfully assigned snapshotting-519/pvc-snapshottable-data-tester-87bsp to e2e-84b410effb-9cdc3-windows-node-group-m1w4 Jan 22 03:10:01.627: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-tester-qrtvj: { } Scheduled: Successfully assigned snapshotting-519/pvc-snapshottable-tester-qrtvj to e2e-84b410effb-9cdc3-windows-node-group-jw99 Jan 22 03:10:01.627: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for restored-pvc-tester-f6prk: { } Scheduled: Successfully assigned snapshotting-519/restored-pvc-tester-f6prk to e2e-84b410effb-9cdc3-windows-node-group-fwqs Jan 22 03:10:01.627: INFO: At 2021-01-22 03:03:59 +0000 UTC - event for csi-gcepd-sc-windowsz7smz: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 22 03:10:01.627: INFO: At 2021-01-22 03:03:59 +0000 UTC - event for csi-gcepd-sc-windowsz7smz: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 22 03:10:01.627: INFO: At 2021-01-22 03:03:59 +0000 UTC - event for csi-gcepd-sc-windowsz7smz: {pd.csi.storage.gke.io_e2e-84b410effb-9cdc3-minion-group-7b60_84c79308-bfa9-4508-bbea-a9ffb5709556 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-519/csi-gcepd-sc-windowsz7smz" Jan 22 03:10:01.627: INFO: At 2021-01-22 03:04:03 +0000 UTC - event for csi-gcepd-sc-windowsz7smz: {pd.csi.storage.gke.io_e2e-84b410effb-9cdc3-minion-group-7b60_84c79308-bfa9-4508-bbea-a9ffb5709556 } ProvisioningSucceeded: Successfully provisioned volume pvc-b8e4eea5-c434-463b-b612-63e9d1d8c4fc Jan 22 03:10:01.627: INFO: At 2021-01-22 03:04:13 +0000 UTC - event for pvc-snapshottable-tester-qrtvj: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-b8e4eea5-c434-463b-b612-63e9d1d8c4fc" Jan 22 03:10:01.627: INFO: At 2021-01-22 03:05:17 +0000 UTC - event for pvc-snapshottable-tester-qrtvj: {kubelet e2e-84b410effb-9cdc3-windows-node-group-jw99} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 03:10:01.627: INFO: At 2021-01-22 03:05:18 +0000 UTC - event for pvc-snapshottable-tester-qrtvj: {kubelet e2e-84b410effb-9cdc3-windows-node-group-jw99} Created: Created container volume-tester Jan 22 03:10:01.627: INFO: At 2021-01-22 03:05:20 +0000 UTC - event for pvc-snapshottable-tester-qrtvj: {kubelet e2e-84b410effb-9cdc3-windows-node-group-jw99} Started: Started container volume-tester Jan 22 03:10:01.627: INFO: At 2021-01-22 03:05:32 +0000 UTC - event for snapshot-j8s7f: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-519/snapshot-j8s7f to be created by the CSI driver. Jan 22 03:10:01.627: INFO: At 2021-01-22 03:05:50 +0000 UTC - event for pvc-snapshottable-data-tester-87bsp: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-b8e4eea5-c434-463b-b612-63e9d1d8c4fc" Volume is already exclusively attached to one node and can't be attached to another Jan 22 03:10:01.627: INFO: At 2021-01-22 03:06:26 +0000 UTC - event for pvc-snapshottable-data-tester-87bsp: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-b8e4eea5-c434-463b-b612-63e9d1d8c4fc" Jan 22 03:10:01.627: INFO: At 2021-01-22 03:07:21 +0000 UTC - event for pvc-snapshottable-data-tester-87bsp: {kubelet e2e-84b410effb-9cdc3-windows-node-group-m1w4} Created: Created container volume-tester Jan 22 03:10:01.627: INFO: At 2021-01-22 03:07:21 +0000 UTC - event for pvc-snapshottable-data-tester-87bsp: {kubelet e2e-84b410effb-9cdc3-windows-node-group-m1w4} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 03:10:01.627: INFO: At 2021-01-22 03:07:23 +0000 UTC - event for pvc-snapshottable-data-tester-87bsp: {kubelet e2e-84b410effb-9cdc3-windows-node-group-m1w4} Started: Started container volume-tester Jan 22 03:10:01.627: INFO: At 2021-01-22 03:07:34 +0000 UTC - event for pvc-fnzjl: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 22 03:10:01.627: INFO: At 2021-01-22 03:07:34 +0000 UTC - event for pvc-fnzjl: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 22 03:10:01.627: INFO: At 2021-01-22 03:07:35 +0000 UTC - event for pvc-fnzjl: {pd.csi.storage.gke.io_e2e-84b410effb-9cdc3-minion-group-7b60_84c79308-bfa9-4508-bbea-a9ffb5709556 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-519/pvc-fnzjl" Jan 22 03:10:01.627: INFO: At 2021-01-22 03:07:57 +0000 UTC - event for pvc-fnzjl: {pd.csi.storage.gke.io_e2e-84b410effb-9cdc3-minion-group-7b60_84c79308-bfa9-4508-bbea-a9ffb5709556 } ProvisioningSucceeded: Successfully provisioned volume pvc-841c0022-d21a-42bd-aaa3-70ad27d2a117 Jan 22 03:10:01.627: INFO: At 2021-01-22 03:08:07 +0000 UTC - event for restored-pvc-tester-f6prk: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-841c0022-d21a-42bd-aaa3-70ad27d2a117" Jan 22 03:10:01.627: INFO: At 2021-01-22 03:08:37 +0000 UTC - event for restored-pvc-tester-f6prk: {kubelet e2e-84b410effb-9cdc3-windows-node-group-fwqs} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 03:10:01.627: INFO: At 2021-01-22 03:08:37 +0000 UTC - event for restored-pvc-tester-f6prk: {kubelet e2e-84b410effb-9cdc3-windows-node-group-fwqs} Created: Created container volume-tester Jan 22 03:10:01.627: INFO: At 2021-01-22 03:08:40 +0000 UTC - event for restored-pvc-tester-f6prk: {kubelet e2e-84b410effb-9cdc3-windows-node-group-fwqs} Started: Started container volume-tester Jan 22 03:10:01.627: INFO: At 2021-01-22 03:09:43 +0000 UTC - event for restored-pvc-tester-f6prk: {kubelet e2e-84b410effb-9cdc3-windows-node-group-fwqs} Killing: Stopping container volume-tester Jan 22 03:10:01.662: INFO: POD NODE PHASE GRACE CONDITIONS Jan 22 03:10:01.662: INFO: Jan 22 03:10:01.714: INFO: Logging node info for node e2e-84b410effb-9cdc3-master Jan 22 03:10:01.751: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-master 9415d327-2010-477c-9ddb-f60f74eeec0b 11214 0 2021-01-22 02:11:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 02:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2021-01-22 02:45:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 02:50:24 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3866853376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3604709376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:11:09 +0000 UTC,LastTransitionTime:2021-01-22 02:11:09 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:28 +0000 UTC,LastTransitionTime:2021-01-22 02:11:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:28 +0000 UTC,LastTransitionTime:2021-01-22 02:11:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:28 +0000 UTC,LastTransitionTime:2021-01-22 02:11:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:06:28 +0000 UTC,LastTransitionTime:2021-01-22 02:11:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.87.64,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-master.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-master.c.k8s-jkns-gci-gce-flaky.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c761ed18e6f248dc9c4c3ea1ef2330a0,SystemUUID:c761ed18-e6f2-48dc-9c4c-3ea1ef2330a0,BootID:e8a09152-30aa-4cfa-9e70-7f1d428c6def,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.21.0-alpha.1.246_f8ca5ad18a2452],SizeBytes:123005230,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.21.0-alpha.1.246_f8ca5ad18a2452],SizeBytes:117520714,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:70314658,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.21.0-alpha.1.246_f8ca5ad18a2452],SizeBytes:47716661,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 03:10:01.752: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-master Jan 22 03:10:01.799: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-master Jan 22 03:10:01.857: INFO: etcd-server-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:09:59 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:01.857: INFO: Container etcd-container ready: true, restart count 0 Jan 22 03:10:01.857: INFO: kube-controller-manager-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:10:19 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:01.857: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 22 03:10:01.857: INFO: kube-scheduler-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:10:29 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:01.857: INFO: Container kube-scheduler ready: true, restart count 0 Jan 22 03:10:01.857: INFO: kube-addon-manager-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:10:45 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:01.857: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 22 03:10:01.857: INFO: l7-lb-controller-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:10:55 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:01.857: INFO: Container l7-lb-controller ready: true, restart count 0 Jan 22 03:10:01.857: INFO: csi-gce-pd-node-mkg7b started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:10:01.857: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:10:01.857: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 03:10:01.857: INFO: etcd-server-events-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:09:49 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:01.857: INFO: Container etcd-container ready: true, restart count 0 Jan 22 03:10:01.857: INFO: kube-apiserver-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:10:09 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:01.857: INFO: Container kube-apiserver ready: true, restart count 0 Jan 22 03:10:01.857: INFO: metadata-proxy-v0.1-nqj2z started at 2021-01-22 02:11:20 +0000 UTC (0+2 container statuses recorded) Jan 22 03:10:01.857: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 03:10:01.857: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 W0122 03:10:01.927920 68139 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:10:02.662: INFO: Latency metrics for node e2e-84b410effb-9cdc3-master Jan 22 03:10:02.663: INFO: Logging node info for node e2e-84b410effb-9cdc3-minion-group-7b60 Jan 22 03:10:02.704: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-minion-group-7b60 d47f4866-9418-43c5-941b-3197838234c4 11199 0 2021-01-22 02:11:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-minion-group-7b60 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-minion-group-7b60"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 02:11:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.5.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-22 02:11:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-22 02:45:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 02:50:25 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.5.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-minion-group-7b60,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.5.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-22 03:06:25 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-22 03:06:25 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-22 03:06:25 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-22 03:06:25 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-22 03:06:25 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-22 03:06:25 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-22 03:06:25 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:11:15 +0000 UTC,LastTransitionTime:2021-01-22 02:11:15 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:18 +0000 UTC,LastTransitionTime:2021-01-22 02:11:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:18 +0000 UTC,LastTransitionTime:2021-01-22 02:11:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:18 +0000 UTC,LastTransitionTime:2021-01-22 02:11:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:06:18 +0000 UTC,LastTransitionTime:2021-01-22 02:11:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.7,},NodeAddress{Type:ExternalIP,Address:34.83.22.158,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-minion-group-7b60.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-minion-group-7b60.c.k8s-jkns-gci-gce-flaky.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e546e417b95db65db9be32f38931e0ac,SystemUUID:e546e417-b95d-b65d-b9be-32f38931e0ac,BootID:92b5329f-0485-43ec-b75a-e78d9380e3f9,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.246_f8ca5ad18a2452],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:70314658,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:bec571992d40203edcd056ac0b0d97003887ee5e4be144c41932d18639673b03 k8s.gcr.io/sig-storage/csi-provisioner:v2.0.4],SizeBytes:20428748,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:e5ce22ddc2a6fbc9b5729dbcfaf1159c4b0d48dad62ddd1b93503c1348e4a406 k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.1],SizeBytes:19498883,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:ca160717df7f6b7964c936faf608b914f2277363e6d708ea2e2dbbf2c5f56a83 k8s.gcr.io/sig-storage/csi-resizer:v1.0.1],SizeBytes:19463877,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:7495d30800fb3ef22f3dc6d5fe9a0a6ec40ba32a2bdc0cf5e7fcaa507adc921e k8s.gcr.io/sig-storage/csi-attacher:v3.0.1],SizeBytes:19460260,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 03:10:02.706: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-minion-group-7b60 Jan 22 03:10:02.744: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-minion-group-7b60 Jan 22 03:10:02.811: INFO: coredns-6954c77b9b-7rkd6 started at 2021-01-22 02:11:34 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:02.811: INFO: Container coredns ready: true, restart count 0 Jan 22 03:10:02.811: INFO: csi-gce-pd-controller-95cd8d997-zghb5 started at 2021-01-22 02:45:44 +0000 UTC (0+5 container statuses recorded) Jan 22 03:10:02.811: INFO: Container csi-attacher ready: true, restart count 0 Jan 22 03:10:02.811: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 03:10:02.811: INFO: Container csi-resizer ready: true, restart count 0 Jan 22 03:10:02.811: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 22 03:10:02.811: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 03:10:02.811: INFO: csi-gce-pd-node-x9fjz started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:10:02.811: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:10:02.811: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 03:10:02.811: INFO: kube-proxy-e2e-84b410effb-9cdc3-minion-group-7b60 started at 2021-01-22 02:11:14 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:02.811: INFO: Container kube-proxy ready: true, restart count 0 Jan 22 03:10:02.811: INFO: metadata-proxy-v0.1-b6qwj started at 2021-01-22 02:11:14 +0000 UTC (0+2 container statuses recorded) Jan 22 03:10:02.811: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 03:10:02.812: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 22 03:10:02.812: INFO: metrics-server-v0.3.6-8b98f98c9-s9kwm started at 2021-01-22 02:12:02 +0000 UTC (0+2 container statuses recorded) Jan 22 03:10:02.812: INFO: Container metrics-server ready: true, restart count 0 Jan 22 03:10:02.812: INFO: Container metrics-server-nanny ready: true, restart count 0 W0122 03:10:02.923011 68139 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:10:03.184: INFO: Latency metrics for node e2e-84b410effb-9cdc3-minion-group-7b60 Jan 22 03:10:03.184: INFO: Logging node info for node e2e-84b410effb-9cdc3-minion-group-pqjj Jan 22 03:10:03.224: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-minion-group-pqjj b394e111-171e-41ab-88f5-665f81cd77b8 11215 0 2021-01-22 02:11:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-minion-group-pqjj kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-minion-group-pqjj"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 02:11:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-22 02:11:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-22 02:45:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 02:50:25 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-minion-group-pqjj,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-22 03:06:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-22 03:06:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-22 03:06:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-22 03:06:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-22 03:06:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-22 03:06:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-22 03:06:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:11:16 +0000 UTC,LastTransitionTime:2021-01-22 02:11:16 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:28 +0000 UTC,LastTransitionTime:2021-01-22 02:11:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:28 +0000 UTC,LastTransitionTime:2021-01-22 02:11:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:28 +0000 UTC,LastTransitionTime:2021-01-22 02:11:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:06:28 +0000 UTC,LastTransitionTime:2021-01-22 02:11:26 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.6,},NodeAddress{Type:ExternalIP,Address:35.233.209.181,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-minion-group-pqjj.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-minion-group-pqjj.c.k8s-jkns-gci-gce-flaky.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69dde29e3ff2b59d8dd7d53f7b31018e,SystemUUID:69dde29e-3ff2-b59d-8dd7-d53f7b31018e,BootID:d14f3b11-55a8-40dd-be51-2aa20b9d88ba,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.246_f8ca5ad18a2452],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:70314658,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:a494ff6ec10e05a454458fbf44247d93c9b3a0d983a00b538e442f353b7030c8 k8s.gcr.io/sig-storage/snapshot-controller:v3.0.2],SizeBytes:17461280,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 03:10:03.225: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-minion-group-pqjj Jan 22 03:10:03.262: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-minion-group-pqjj Jan 22 03:10:03.330: INFO: metadata-proxy-v0.1-g59g4 started at 2021-01-22 02:11:16 +0000 UTC (0+2 container statuses recorded) Jan 22 03:10:03.330: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 03:10:03.330: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 22 03:10:03.330: INFO: l7-default-backend-6dd8477499-sm248 started at 2021-01-22 02:11:28 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:03.330: INFO: Container default-http-backend ready: true, restart count 0 Jan 22 03:10:03.330: INFO: kube-dns-autoscaler-76478fcf46-k8z99 started at 2021-01-22 02:11:30 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:03.331: INFO: Container autoscaler ready: true, restart count 0 Jan 22 03:10:03.331: INFO: coredns-6954c77b9b-wxkj2 started at 2021-01-22 02:11:33 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:03.331: INFO: Container coredns ready: true, restart count 0 Jan 22 03:10:03.331: INFO: volume-snapshot-controller-0 started at 2021-01-22 02:11:34 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:03.331: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jan 22 03:10:03.331: INFO: csi-gce-pd-node-kvhv5 started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:10:03.331: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:10:03.331: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 03:10:03.331: INFO: kube-proxy-e2e-84b410effb-9cdc3-minion-group-pqjj started at 2021-01-22 02:11:16 +0000 UTC (0+1 container statuses recorded) Jan 22 03:10:03.331: INFO: Container kube-proxy ready: true, restart count 0 W0122 03:10:03.409602 68139 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:10:03.659: INFO: Latency metrics for node e2e-84b410effb-9cdc3-minion-group-pqjj Jan 22 03:10:03.659: INFO: Logging node info for node e2e-84b410effb-9cdc3-windows-node-group-fwqs Jan 22 03:10:03.697: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-windows-node-group-fwqs 03ada1ed-2848-4578-b26b-3409d84a67a7 11980 0 2021-01-22 02:13:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-windows-node-group-fwqs kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-windows-node-group-fwqs"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 03:08:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet.exe Update v1 2021-01-22 03:10:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-windows-node-group-fwqs,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:13:42 +0000 UTC,LastTransitionTime:2021-01-22 02:13:42 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:10:00 +0000 UTC,LastTransitionTime:2021-01-22 02:13:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:10:00 +0000 UTC,LastTransitionTime:2021-01-22 02:13:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:10:00 +0000 UTC,LastTransitionTime:2021-01-22 02:13:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:10:00 +0000 UTC,LastTransitionTime:2021-01-22 02:13:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.230.36.104,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-windows-node-group-fwqs.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-windows-node-group-fwqs,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-84b410effb-9cdc3-windows-node-group-fwqs,SystemUUID:2605E1CF-F954-B8A7-C371-67879EA3A75A,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 22 03:10:03.698: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-windows-node-group-fwqs Jan 22 03:10:03.737: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-windows-node-group-fwqs Jan 22 03:10:03.783: INFO: csi-gce-pd-node-win-qkss4 started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:10:03.783: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:10:03.783: INFO: Container gce-pd-driver ready: true, restart count 0 W0122 03:10:03.855081 68139 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:10:04.089: INFO: Latency metrics for node e2e-84b410effb-9cdc3-windows-node-group-fwqs Jan 22 03:10:04.089: INFO: Logging node info for node e2e-84b410effb-9cdc3-windows-node-group-jw99 Jan 22 03:10:04.127: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-windows-node-group-jw99 904a9c2a-6648-4d9f-a11e-49987deab805 11279 0 2021-01-22 02:13:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-windows-node-group-jw99 kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-windows-node-group-jw99"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 02:51:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet.exe Update v1 2021-01-22 03:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-windows-node-group-jw99,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:13:45 +0000 UTC,LastTransitionTime:2021-01-22 02:13:45 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:43 +0000 UTC,LastTransitionTime:2021-01-22 02:13:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:43 +0000 UTC,LastTransitionTime:2021-01-22 02:13:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:06:43 +0000 UTC,LastTransitionTime:2021-01-22 02:13:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:06:43 +0000 UTC,LastTransitionTime:2021-01-22 02:13:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.135.248,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-windows-node-group-jw99.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-windows-node-group-jw99,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-84b410effb-9cdc3-windows-node-group-jw99,SystemUUID:6AD86565-A22D-BC4E-82AA-6E80BE66D591,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 22 03:10:04.127: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-windows-node-group-jw99 Jan 22 03:10:04.165: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-windows-node-group-jw99 Jan 22 03:10:04.215: INFO: csi-gce-pd-node-win-pqp9m started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:10:04.215: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:10:04.215: INFO: Container gce-pd-driver ready: true, restart count 0 W0122 03:10:04.287370 68139 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:10:04.507: INFO: Latency metrics for node e2e-84b410effb-9cdc3-windows-node-group-jw99 Jan 22 03:10:04.507: INFO: Logging node info for node e2e-84b410effb-9cdc3-windows-node-group-m1w4 Jan 22 03:10:04.545: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-windows-node-group-m1w4 57b62334-4ffe-4ed3-b22b-65c09d81b6a3 11589 0 2021-01-22 02:13:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-windows-node-group-m1w4 kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-windows-node-group-m1w4"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 02:54:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet.exe Update v1 2021-01-22 03:08:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-windows-node-group-m1w4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:13:57 +0000 UTC,LastTransitionTime:2021-01-22 02:13:57 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:08:03 +0000 UTC,LastTransitionTime:2021-01-22 02:13:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:08:03 +0000 UTC,LastTransitionTime:2021-01-22 02:13:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:08:03 +0000 UTC,LastTransitionTime:2021-01-22 02:13:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:08:03 +0000 UTC,LastTransitionTime:2021-01-22 02:14:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.14.136,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-windows-node-group-m1w4.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-windows-node-group-m1w4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-84b410effb-9cdc3-windows-node-group-m1w4,SystemUUID:408F617E-C42C-A098-944F-74104283C0D5,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 22 03:10:04.546: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-windows-node-group-m1w4 Jan 22 03:10:04.584: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-windows-node-group-m1w4 Jan 22 03:10:04.635: INFO: csi-gce-pd-node-win-z5jkt started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:10:04.635: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:10:04.635: INFO: Container gce-pd-driver ready: true, restart count 0 W0122 03:10:04.697317 68139 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:10:04.946: INFO: Latency metrics for node e2e-84b410effb-9cdc3-windows-node-group-m1w4 Jan 22 03:10:04.946: INFO: Waiting up to 3m0s for all (but 3) nodes to be ready �[1mSTEP�[0m: Destroying namespace "snapshotting-519" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=External\sStorage\s\[Driver\:\scsi\-gcepd\-sc\-windows\]\s\[Testpattern\:\sPre\-provisioned\sSnapshot\s\(delete\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion$'
/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 Jan 22 03:05:18.263: Unexpected error: <*errors.errorString | 0xc003be8060>: { s: "Failed to find \"hello from snapshotting-4461 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-4461 namespace", last result: "���������������������������������������� " occurred /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268from junit_pdcsi.xml
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 22 02:59:03.255: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] volume snapshot controller /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:176 Jan 22 02:59:03.440: INFO: Creating resource for dynamic PV Jan 22 02:59:03.441: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-4461-e2e-scfwdr4 �[1mSTEP�[0m: creating a claim Jan 22 02:59:03.478: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: starting a pod to use the claim Jan 22 02:59:03.597: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-64xw4" in namespace "snapshotting-4461" to be "Succeeded or Failed" Jan 22 02:59:03.641: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 43.581739ms Jan 22 02:59:05.677: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.079424025s Jan 22 02:59:07.715: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.117426461s Jan 22 02:59:09.750: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.152813604s Jan 22 02:59:11.788: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.190556657s Jan 22 02:59:13.823: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.22606809s Jan 22 02:59:15.859: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 12.261634405s Jan 22 02:59:17.895: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 14.298049281s Jan 22 02:59:19.931: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 16.333588756s Jan 22 02:59:21.967: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 18.369434427s Jan 22 02:59:24.003: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 20.405341926s Jan 22 02:59:26.038: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 22.440905206s Jan 22 02:59:28.074: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 24.476452323s Jan 22 02:59:30.110: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 26.512681245s Jan 22 02:59:32.145: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 28.547587167s Jan 22 02:59:34.180: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 30.583008152s Jan 22 02:59:36.218: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 32.62108956s Jan 22 02:59:38.254: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 34.656632949s Jan 22 02:59:40.295: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 36.697814073s Jan 22 02:59:42.331: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 38.733450412s Jan 22 02:59:44.367: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 40.769539126s Jan 22 02:59:46.402: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 42.804988947s Jan 22 02:59:48.439: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 44.841640696s Jan 22 02:59:50.474: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 46.877302739s Jan 22 02:59:52.517: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 48.919371955s Jan 22 02:59:54.552: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 50.955029256s Jan 22 02:59:56.590: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 52.992722978s Jan 22 02:59:58.630: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 55.032749339s Jan 22 03:00:00.665: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 57.068137724s Jan 22 03:00:02.701: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 59.103626181s Jan 22 03:00:04.737: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.139333319s Jan 22 03:00:06.772: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.175317645s Jan 22 03:00:08.808: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.210738987s Jan 22 03:00:10.843: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.246045066s Jan 22 03:00:12.880: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.282475361s Jan 22 03:00:14.916: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.31898756s Jan 22 03:00:17.234: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.636690051s Jan 22 03:00:19.269: INFO: Pod "pvc-snapshottable-tester-64xw4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m15.67228841s �[1mSTEP�[0m: Saw pod success Jan 22 03:00:19.270: INFO: Pod "pvc-snapshottable-tester-64xw4" satisfied condition "Succeeded or Failed" Jan 22 03:00:19.472: INFO: Pod pvc-snapshottable-tester-64xw4 has the following logs: Jan 22 03:00:19.472: INFO: Deleting pod "pvc-snapshottable-tester-64xw4" in namespace "snapshotting-4461" Jan 22 03:00:19.514: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-64xw4" to be fully deleted Jan 22 03:00:19.549: INFO: Waiting up to 5m0s for PersistentVolumeClaims [csi-gcepd-sc-windowsm92cv] to have phase Bound Jan 22 03:00:19.584: INFO: PersistentVolumeClaim csi-gcepd-sc-windowsm92cv found and phase=Bound (34.789526ms) �[1mSTEP�[0m: checking the claim �[1mSTEP�[0m: checking the PV [BeforeEach] /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:190 �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jan 22 03:00:19.778: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-5pl9n to become ready Jan 22 03:00:19.822: INFO: VolumeSnapshot snapshot-5pl9n found but is not ready. Jan 22 03:00:21.859: INFO: VolumeSnapshot snapshot-5pl9n found but is not ready. Jan 22 03:00:23.895: INFO: VolumeSnapshot snapshot-5pl9n found but is not ready. Jan 22 03:00:25.931: INFO: VolumeSnapshot snapshot-5pl9n found but is not ready. Jan 22 03:00:27.967: INFO: VolumeSnapshot snapshot-5pl9n found but is not ready. Jan 22 03:00:30.029: INFO: VolumeSnapshot snapshot-5pl9n found but is not ready. Jan 22 03:00:32.065: INFO: VolumeSnapshot snapshot-5pl9n found but is not ready. Jan 22 03:00:34.101: INFO: VolumeSnapshot snapshot-5pl9n found but is not ready. Jan 22 03:00:36.137: INFO: VolumeSnapshot snapshot-5pl9n found but is not ready. Jan 22 03:00:38.173: INFO: VolumeSnapshot snapshot-5pl9n found and is ready Jan 22 03:00:38.173: INFO: WaitUntil finished successfully after 18.395047957s Jan 22 03:00:38.209: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-8bba79b3-2b90-43a8-875b-e8a547f41fa7 creationTime:2021-01-22T03:00:20Z readyToUse:true restoreSize:5Gi] Jan 22 03:00:38.209: INFO: snapshotContentName snapcontent-8bba79b3-2b90-43a8-875b-e8a547f41fa7 �[1mSTEP�[0m: updating the snapshot content deletion policy to retain �[1mSTEP�[0m: recording the volume handle and snapshotHandle Jan 22 03:00:38.285: INFO: Recording snapshot handle: projects/k8s-jkns-gci-gce-flaky/global/snapshots/snapshot-8bba79b3-2b90-43a8-875b-e8a547f41fa7 �[1mSTEP�[0m: deleting the snapshot and snapshot content �[1mSTEP�[0m: checking the Snapshot has been deleted Jan 22 03:00:38.326: INFO: Waiting up to 5m0s for volumesnapshots snapshotting-4461 to be deleted Jan 22 03:00:38.367: INFO: volumesnapshots snapshotting-4461 is not found in namespace snapshot-5pl9n and has been deleted Jan 22 03:00:38.367: INFO: WaitUntil finished successfully after 41.488563ms �[1mSTEP�[0m: checking the Snapshot content has been deleted Jan 22 03:00:38.413: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-8bba79b3-2b90-43a8-875b-e8a547f41fa7 to be deleted Jan 22 03:00:38.448: INFO: volumesnapshotcontents snapcontent-8bba79b3-2b90-43a8-875b-e8a547f41fa7 is not found and has been deleted Jan 22 03:00:38.448: INFO: WaitUntil finished successfully after 35.292961ms �[1mSTEP�[0m: creating a snapshot content with the snapshot handle �[1mSTEP�[0m: creating a snapshot with that snapshot content Jan 22 03:00:38.526: INFO: Waiting up to 5m0s for VolumeSnapshot pre-provisioned-snapshot-edc98b70-8529-4d72-bbe8-2ebd383ce639 to become ready Jan 22 03:00:38.570: INFO: VolumeSnapshot pre-provisioned-snapshot-edc98b70-8529-4d72-bbe8-2ebd383ce639 found but is not ready. Jan 22 03:00:40.607: INFO: VolumeSnapshot pre-provisioned-snapshot-edc98b70-8529-4d72-bbe8-2ebd383ce639 found and is ready Jan 22 03:00:40.612: INFO: WaitUntil finished successfully after 2.085424202s �[1mSTEP�[0m: getting the snapshot and snapshot content [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: Modifying source data test �[1mSTEP�[0m: modifying the data in the source PVC Jan 22 03:00:40.798: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-4f9sf" in namespace "snapshotting-4461" to be "Succeeded or Failed" Jan 22 03:00:40.835: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 37.468464ms Jan 22 03:00:42.872: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.073741755s Jan 22 03:00:44.907: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 4.109182683s Jan 22 03:00:46.943: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 6.145475655s Jan 22 03:00:48.979: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 8.181222471s Jan 22 03:00:51.015: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 10.21672401s Jan 22 03:00:53.051: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 12.252564996s Jan 22 03:00:55.087: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 14.288643621s Jan 22 03:00:57.122: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 16.323772177s Jan 22 03:00:59.157: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 18.359301974s Jan 22 03:01:01.193: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 20.395368996s Jan 22 03:01:03.229: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 22.431109273s Jan 22 03:01:05.265: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 24.466771713s Jan 22 03:01:07.300: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 26.502076981s Jan 22 03:01:09.335: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 28.537472263s Jan 22 03:01:11.371: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 30.572955844s Jan 22 03:01:13.407: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 32.608767988s Jan 22 03:01:15.442: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 34.644245765s Jan 22 03:01:17.478: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 36.679931189s Jan 22 03:01:19.513: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 38.715417166s Jan 22 03:01:21.553: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 40.754910749s Jan 22 03:01:23.589: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 42.791506437s Jan 22 03:01:25.625: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 44.827354412s Jan 22 03:01:27.661: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 46.863508956s Jan 22 03:01:29.699: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 48.901369536s Jan 22 03:01:31.735: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 50.937271125s Jan 22 03:01:33.775: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 52.977439736s Jan 22 03:01:35.811: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 55.012960108s Jan 22 03:01:37.846: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 57.048135379s Jan 22 03:01:39.882: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 59.083627099s Jan 22 03:01:41.918: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.119922828s Jan 22 03:01:43.954: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.155730864s Jan 22 03:01:45.989: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.191123069s Jan 22 03:01:48.025: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.226923787s Jan 22 03:01:50.061: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.262700564s Jan 22 03:01:52.100: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.301603721s Jan 22 03:01:54.141: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.343053667s Jan 22 03:01:56.177: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.379011884s Jan 22 03:01:58.213: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.414634708s Jan 22 03:02:00.248: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.450474781s Jan 22 03:02:02.303: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.505044919s Jan 22 03:02:04.338: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.540424157s Jan 22 03:02:06.374: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.576129152s Jan 22 03:02:08.410: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.612160115s Jan 22 03:02:10.446: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.647757128s Jan 22 03:02:12.484: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.685569631s Jan 22 03:02:14.519: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.720940736s Jan 22 03:02:16.554: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m35.756379719s Jan 22 03:02:18.591: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.792860815s Jan 22 03:02:20.626: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m39.828511783s Jan 22 03:02:22.662: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m41.864374119s Jan 22 03:02:24.703: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m43.905425485s Jan 22 03:02:26.739: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m45.940798322s Jan 22 03:02:28.774: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m47.976184559s Jan 22 03:02:30.809: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.011389895s Jan 22 03:02:32.845: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.046681973s Jan 22 03:02:34.880: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.082170453s Jan 22 03:02:36.916: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.11791354s Jan 22 03:02:38.952: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.153614284s Jan 22 03:02:40.987: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.188774031s Jan 22 03:02:43.022: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.224416571s Jan 22 03:02:45.058: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.259997318s Jan 22 03:02:47.094: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.295612818s Jan 22 03:02:49.131: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.332701979s Jan 22 03:02:51.169: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.370633197s Jan 22 03:02:53.204: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.406299175s Jan 22 03:02:55.240: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.441993521s Jan 22 03:02:57.276: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.478010633s Jan 22 03:02:59.311: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.513325189s Jan 22 03:03:01.368: INFO: Pod "pvc-snapshottable-data-tester-4f9sf": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2m20.570139447s �[1mSTEP�[0m: Saw pod success Jan 22 03:03:01.368: INFO: Pod "pvc-snapshottable-data-tester-4f9sf" satisfied condition "Succeeded or Failed" Jan 22 03:03:01.636: INFO: Pod pvc-snapshottable-data-tester-4f9sf has the following logs: Jan 22 03:03:01.636: INFO: Deleting pod "pvc-snapshottable-data-tester-4f9sf" in namespace "snapshotting-4461" Jan 22 03:03:01.690: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-4f9sf" to be fully deleted �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the claim Jan 22 03:04:15.915: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:04:18.912: INFO: stderr: "" Jan 22 03:04:18.912: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:04:20.912: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:04:22.565: INFO: stderr: "" Jan 22 03:04:22.566: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:04:24.566: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:04:26.082: INFO: stderr: "" Jan 22 03:04:26.082: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:04:28.082: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:04:29.917: INFO: stderr: "" Jan 22 03:04:29.917: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:04:31.917: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:04:34.611: INFO: stderr: "" Jan 22 03:04:34.611: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:04:36.611: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:04:38.620: INFO: stderr: "" Jan 22 03:04:38.620: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:04:40.620: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:04:43.273: INFO: stderr: "" Jan 22 03:04:43.273: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:04:45.274: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:04:48.881: INFO: stderr: "" Jan 22 03:04:48.881: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:04:50.881: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:04:53.680: INFO: stderr: "" Jan 22 03:04:53.680: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:04:55.680: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:04:57.865: INFO: stderr: "" Jan 22 03:04:57.865: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:04:59.865: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:05:02.364: INFO: stderr: "" Jan 22 03:05:02.364: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:05:04.364: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:05:06.944: INFO: stderr: "" Jan 22 03:05:06.945: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:05:08.945: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:05:11.413: INFO: stderr: "" Jan 22 03:05:11.413: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:05:13.414: INFO: Running '/tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/bin/kubectl --server=https://34.83.87.64 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-4461 exec restored-pvc-tester-l4zjd --namespace=snapshotting-4461 -- powershell /c type /mnt/test/data' Jan 22 03:05:16.262: INFO: stderr: "" Jan 22 03:05:16.262: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 03:05:18.263: FAIL: Unexpected error: <*errors.errorString | 0xc003be8060>: { s: "Failed to find \"hello from snapshotting-4461 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-4461 namespace", last result: "���������������������������������������� " occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.5.2() /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268 +0x1254 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003458600) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc003458600) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc003458600, 0x4ff25a8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] volume snapshot controller /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:179 Jan 22 03:05:18.471: INFO: Pod restored-pvc-tester-l4zjd has the following logs: Jan 22 03:05:18.471: INFO: Deleting pod "restored-pvc-tester-l4zjd" in namespace "snapshotting-4461" Jan 22 03:05:18.515: INFO: Wait up to 5m0s for pod "restored-pvc-tester-l4zjd" to be fully deleted Jan 22 03:05:34.592: INFO: deleting claim "snapshotting-4461"/"pvc-f2zn4" Jan 22 03:05:34.629: INFO: deleting snapshot "snapshotting-4461"/"pre-provisioned-snapshot-edc98b70-8529-4d72-bbe8-2ebd383ce639" Jan 22 03:05:34.668: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:pre-provisioned-snapcontent-edc98b70-8529-4d72-bbe8-2ebd383ce639 creationTime:2021-01-22T03:00:20Z readyToUse:true restoreSize:5Gi] Jan 22 03:05:34.668: INFO: snapshotContentName pre-provisioned-snapcontent-edc98b70-8529-4d72-bbe8-2ebd383ce639 Jan 22 03:05:34.776: INFO: Waiting up to 5m0s for volumesnapshotcontents pre-provisioned-snapcontent-edc98b70-8529-4d72-bbe8-2ebd383ce639 to be deleted Jan 22 03:05:34.819: INFO: volumesnapshotcontents pre-provisioned-snapcontent-edc98b70-8529-4d72-bbe8-2ebd383ce639 has been found and is not deleted Jan 22 03:05:36.855: INFO: volumesnapshotcontents pre-provisioned-snapcontent-edc98b70-8529-4d72-bbe8-2ebd383ce639 has been found and is not deleted Jan 22 03:05:38.892: INFO: volumesnapshotcontents pre-provisioned-snapcontent-edc98b70-8529-4d72-bbe8-2ebd383ce639 has been found and is not deleted Jan 22 03:05:40.928: INFO: volumesnapshotcontents pre-provisioned-snapcontent-edc98b70-8529-4d72-bbe8-2ebd383ce639 has been found and is not deleted Jan 22 03:05:42.968: INFO: volumesnapshotcontents pre-provisioned-snapcontent-edc98b70-8529-4d72-bbe8-2ebd383ce639 has been found and is not deleted Jan 22 03:05:45.004: INFO: volumesnapshotcontents pre-provisioned-snapcontent-edc98b70-8529-4d72-bbe8-2ebd383ce639 has been found and is not deleted Jan 22 03:05:47.040: INFO: volumesnapshotcontents pre-provisioned-snapcontent-edc98b70-8529-4d72-bbe8-2ebd383ce639 is not found and has been deleted Jan 22 03:05:47.040: INFO: WaitUntil finished successfully after 12.263848314s Jan 22 03:05:47.040: INFO: deleting snapshot content "pre-provisioned-snapcontent-edc98b70-8529-4d72-bbe8-2ebd383ce639" Jan 22 03:05:47.075: INFO: deleting snapshot class "snapshotting-4461-vsc9tdpz" Jan 22 03:05:47.113: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-4461-vsc9tdpz to be deleted Jan 22 03:05:47.148: INFO: volumesnapshotclasses snapshotting-4461-vsc9tdpz is not found and has been deleted Jan 22 03:05:47.148: INFO: WaitUntil finished successfully after 34.963675ms �[1mSTEP�[0m: Deleting pvc Jan 22 03:05:47.218: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windowsm92cv" Jan 22 03:05:47.256: INFO: Waiting up to 5m0s for PersistentVolume pvc-f84b69c5-2de2-4c76-8951-c37aa2dcc189 to get deleted Jan 22 03:05:47.290: INFO: PersistentVolume pvc-f84b69c5-2de2-4c76-8951-c37aa2dcc189 found and phase=Released (34.435101ms) Jan 22 03:05:52.326: INFO: PersistentVolume pvc-f84b69c5-2de2-4c76-8951-c37aa2dcc189 was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp101668106/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-4461". �[1mSTEP�[0m: Found 26 events. Jan 22 03:05:52.400: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-data-tester-4f9sf: { } Scheduled: Successfully assigned snapshotting-4461/pvc-snapshottable-data-tester-4f9sf to e2e-84b410effb-9cdc3-windows-node-group-jw99 Jan 22 03:05:52.400: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-tester-64xw4: { } Scheduled: Successfully assigned snapshotting-4461/pvc-snapshottable-tester-64xw4 to e2e-84b410effb-9cdc3-windows-node-group-m1w4 Jan 22 03:05:52.400: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for restored-pvc-tester-l4zjd: { } Scheduled: Successfully assigned snapshotting-4461/restored-pvc-tester-l4zjd to e2e-84b410effb-9cdc3-windows-node-group-jw99 Jan 22 03:05:52.400: INFO: At 2021-01-22 02:59:03 +0000 UTC - event for csi-gcepd-sc-windowsm92cv: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 22 03:05:52.400: INFO: At 2021-01-22 02:59:03 +0000 UTC - event for csi-gcepd-sc-windowsm92cv: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 22 03:05:52.400: INFO: At 2021-01-22 02:59:03 +0000 UTC - event for csi-gcepd-sc-windowsm92cv: {pd.csi.storage.gke.io_e2e-84b410effb-9cdc3-minion-group-7b60_84c79308-bfa9-4508-bbea-a9ffb5709556 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-4461/csi-gcepd-sc-windowsm92cv" Jan 22 03:05:52.400: INFO: At 2021-01-22 02:59:07 +0000 UTC - event for csi-gcepd-sc-windowsm92cv: {pd.csi.storage.gke.io_e2e-84b410effb-9cdc3-minion-group-7b60_84c79308-bfa9-4508-bbea-a9ffb5709556 } ProvisioningSucceeded: Successfully provisioned volume pvc-f84b69c5-2de2-4c76-8951-c37aa2dcc189 Jan 22 03:05:52.400: INFO: At 2021-01-22 02:59:16 +0000 UTC - event for pvc-snapshottable-tester-64xw4: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-f84b69c5-2de2-4c76-8951-c37aa2dcc189" Jan 22 03:05:52.400: INFO: At 2021-01-22 03:00:05 +0000 UTC - event for pvc-snapshottable-tester-64xw4: {kubelet e2e-84b410effb-9cdc3-windows-node-group-m1w4} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 03:05:52.400: INFO: At 2021-01-22 03:00:07 +0000 UTC - event for pvc-snapshottable-tester-64xw4: {kubelet e2e-84b410effb-9cdc3-windows-node-group-m1w4} Created: Created container volume-tester Jan 22 03:05:52.400: INFO: At 2021-01-22 03:00:10 +0000 UTC - event for pvc-snapshottable-tester-64xw4: {kubelet e2e-84b410effb-9cdc3-windows-node-group-m1w4} Started: Started container volume-tester Jan 22 03:05:52.400: INFO: At 2021-01-22 03:00:19 +0000 UTC - event for snapshot-5pl9n: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-4461/snapshot-5pl9n to be created by the CSI driver. Jan 22 03:05:52.400: INFO: At 2021-01-22 03:00:40 +0000 UTC - event for pvc-snapshottable-data-tester-4f9sf: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-f84b69c5-2de2-4c76-8951-c37aa2dcc189" Volume is already exclusively attached to one node and can't be attached to another Jan 22 03:05:52.400: INFO: At 2021-01-22 03:01:13 +0000 UTC - event for pvc-snapshottable-data-tester-4f9sf: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-f84b69c5-2de2-4c76-8951-c37aa2dcc189" Jan 22 03:05:52.400: INFO: At 2021-01-22 03:02:43 +0000 UTC - event for pvc-snapshottable-data-tester-4f9sf: {kubelet e2e-84b410effb-9cdc3-windows-node-group-jw99} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 03:05:52.400: INFO: At 2021-01-22 03:02:44 +0000 UTC - event for pvc-snapshottable-data-tester-4f9sf: {kubelet e2e-84b410effb-9cdc3-windows-node-group-jw99} Created: Created container volume-tester Jan 22 03:05:52.400: INFO: At 2021-01-22 03:02:47 +0000 UTC - event for pvc-snapshottable-data-tester-4f9sf: {kubelet e2e-84b410effb-9cdc3-windows-node-group-jw99} Started: Started container volume-tester Jan 22 03:05:52.400: INFO: At 2021-01-22 03:03:01 +0000 UTC - event for pvc-f2zn4: {pd.csi.storage.gke.io_e2e-84b410effb-9cdc3-minion-group-7b60_84c79308-bfa9-4508-bbea-a9ffb5709556 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-4461/pvc-f2zn4" Jan 22 03:05:52.400: INFO: At 2021-01-22 03:03:01 +0000 UTC - event for pvc-f2zn4: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 22 03:05:52.400: INFO: At 2021-01-22 03:03:01 +0000 UTC - event for pvc-f2zn4: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 22 03:05:52.400: INFO: At 2021-01-22 03:03:26 +0000 UTC - event for pvc-f2zn4: {pd.csi.storage.gke.io_e2e-84b410effb-9cdc3-minion-group-7b60_84c79308-bfa9-4508-bbea-a9ffb5709556 } ProvisioningSucceeded: Successfully provisioned volume pvc-d9711ff8-3a02-438b-aa93-1bf356503444 Jan 22 03:05:52.400: INFO: At 2021-01-22 03:03:36 +0000 UTC - event for restored-pvc-tester-l4zjd: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-d9711ff8-3a02-438b-aa93-1bf356503444" Jan 22 03:05:52.400: INFO: At 2021-01-22 03:04:09 +0000 UTC - event for restored-pvc-tester-l4zjd: {kubelet e2e-84b410effb-9cdc3-windows-node-group-jw99} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 03:05:52.400: INFO: At 2021-01-22 03:04:09 +0000 UTC - event for restored-pvc-tester-l4zjd: {kubelet e2e-84b410effb-9cdc3-windows-node-group-jw99} Created: Created container volume-tester Jan 22 03:05:52.400: INFO: At 2021-01-22 03:04:11 +0000 UTC - event for restored-pvc-tester-l4zjd: {kubelet e2e-84b410effb-9cdc3-windows-node-group-jw99} Started: Started container volume-tester Jan 22 03:05:52.400: INFO: At 2021-01-22 03:05:18 +0000 UTC - event for restored-pvc-tester-l4zjd: {kubelet e2e-84b410effb-9cdc3-windows-node-group-jw99} Killing: Stopping container volume-tester Jan 22 03:05:52.436: INFO: POD NODE PHASE GRACE CONDITIONS Jan 22 03:05:52.436: INFO: Jan 22 03:05:52.478: INFO: Logging node info for node e2e-84b410effb-9cdc3-master Jan 22 03:05:52.515: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-master 9415d327-2010-477c-9ddb-f60f74eeec0b 9809 0 2021-01-22 02:11:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 02:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2021-01-22 02:45:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 02:50:24 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3866853376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3604709376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:11:09 +0000 UTC,LastTransitionTime:2021-01-22 02:11:09 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:01:27 +0000 UTC,LastTransitionTime:2021-01-22 02:11:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:01:27 +0000 UTC,LastTransitionTime:2021-01-22 02:11:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:01:27 +0000 UTC,LastTransitionTime:2021-01-22 02:11:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:01:27 +0000 UTC,LastTransitionTime:2021-01-22 02:11:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.87.64,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-master.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-master.c.k8s-jkns-gci-gce-flaky.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c761ed18e6f248dc9c4c3ea1ef2330a0,SystemUUID:c761ed18-e6f2-48dc-9c4c-3ea1ef2330a0,BootID:e8a09152-30aa-4cfa-9e70-7f1d428c6def,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.21.0-alpha.1.246_f8ca5ad18a2452],SizeBytes:123005230,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.21.0-alpha.1.246_f8ca5ad18a2452],SizeBytes:117520714,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:70314658,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.21.0-alpha.1.246_f8ca5ad18a2452],SizeBytes:47716661,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 03:05:52.518: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-master Jan 22 03:05:52.560: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-master Jan 22 03:05:52.615: INFO: csi-gce-pd-node-mkg7b started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:05:52.615: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:05:52.615: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 03:05:52.615: INFO: etcd-server-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:09:59 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:52.615: INFO: Container etcd-container ready: true, restart count 0 Jan 22 03:05:52.615: INFO: kube-controller-manager-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:10:19 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:52.615: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 22 03:05:52.615: INFO: kube-scheduler-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:10:29 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:52.615: INFO: Container kube-scheduler ready: true, restart count 0 Jan 22 03:05:52.615: INFO: kube-addon-manager-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:10:45 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:52.615: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 22 03:05:52.615: INFO: l7-lb-controller-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:10:55 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:52.615: INFO: Container l7-lb-controller ready: true, restart count 0 Jan 22 03:05:52.615: INFO: etcd-server-events-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:09:49 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:52.615: INFO: Container etcd-container ready: true, restart count 0 Jan 22 03:05:52.615: INFO: kube-apiserver-e2e-84b410effb-9cdc3-master started at 2021-01-22 02:10:09 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:52.615: INFO: Container kube-apiserver ready: true, restart count 0 Jan 22 03:05:52.615: INFO: metadata-proxy-v0.1-nqj2z started at 2021-01-22 02:11:20 +0000 UTC (0+2 container statuses recorded) Jan 22 03:05:52.615: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 03:05:52.615: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 W0122 03:05:52.668744 68129 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:05:52.960: INFO: Latency metrics for node e2e-84b410effb-9cdc3-master Jan 22 03:05:52.960: INFO: Logging node info for node e2e-84b410effb-9cdc3-minion-group-7b60 Jan 22 03:05:52.997: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-minion-group-7b60 d47f4866-9418-43c5-941b-3197838234c4 9795 0 2021-01-22 02:11:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-minion-group-7b60 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-minion-group-7b60"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 02:11:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.5.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-22 02:11:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-22 02:45:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 02:50:25 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.5.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-minion-group-7b60,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.5.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-22 03:01:24 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-22 03:01:24 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-22 03:01:24 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-22 03:01:24 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-22 03:01:24 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-22 03:01:24 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-22 03:01:24 +0000 UTC,LastTransitionTime:2021-01-22 02:11:17 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:11:15 +0000 UTC,LastTransitionTime:2021-01-22 02:11:15 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:01:18 +0000 UTC,LastTransitionTime:2021-01-22 02:11:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:01:18 +0000 UTC,LastTransitionTime:2021-01-22 02:11:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:01:18 +0000 UTC,LastTransitionTime:2021-01-22 02:11:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:01:18 +0000 UTC,LastTransitionTime:2021-01-22 02:11:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.7,},NodeAddress{Type:ExternalIP,Address:34.83.22.158,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-minion-group-7b60.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-minion-group-7b60.c.k8s-jkns-gci-gce-flaky.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e546e417b95db65db9be32f38931e0ac,SystemUUID:e546e417-b95d-b65d-b9be-32f38931e0ac,BootID:92b5329f-0485-43ec-b75a-e78d9380e3f9,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.246_f8ca5ad18a2452],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:70314658,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:bec571992d40203edcd056ac0b0d97003887ee5e4be144c41932d18639673b03 k8s.gcr.io/sig-storage/csi-provisioner:v2.0.4],SizeBytes:20428748,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:e5ce22ddc2a6fbc9b5729dbcfaf1159c4b0d48dad62ddd1b93503c1348e4a406 k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.1],SizeBytes:19498883,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:ca160717df7f6b7964c936faf608b914f2277363e6d708ea2e2dbbf2c5f56a83 k8s.gcr.io/sig-storage/csi-resizer:v1.0.1],SizeBytes:19463877,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:7495d30800fb3ef22f3dc6d5fe9a0a6ec40ba32a2bdc0cf5e7fcaa507adc921e k8s.gcr.io/sig-storage/csi-attacher:v3.0.1],SizeBytes:19460260,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 03:05:52.997: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-minion-group-7b60 Jan 22 03:05:53.035: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-minion-group-7b60 Jan 22 03:05:53.096: INFO: csi-gce-pd-controller-95cd8d997-zghb5 started at 2021-01-22 02:45:44 +0000 UTC (0+5 container statuses recorded) Jan 22 03:05:53.097: INFO: Container csi-attacher ready: true, restart count 0 Jan 22 03:05:53.097: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 03:05:53.097: INFO: Container csi-resizer ready: true, restart count 0 Jan 22 03:05:53.097: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 22 03:05:53.097: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 03:05:53.097: INFO: csi-gce-pd-node-x9fjz started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:05:53.097: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:05:53.097: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 03:05:53.097: INFO: kube-proxy-e2e-84b410effb-9cdc3-minion-group-7b60 started at 2021-01-22 02:11:14 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:53.097: INFO: Container kube-proxy ready: true, restart count 0 Jan 22 03:05:53.097: INFO: metadata-proxy-v0.1-b6qwj started at 2021-01-22 02:11:14 +0000 UTC (0+2 container statuses recorded) Jan 22 03:05:53.097: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 03:05:53.097: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 22 03:05:53.097: INFO: metrics-server-v0.3.6-8b98f98c9-s9kwm started at 2021-01-22 02:12:02 +0000 UTC (0+2 container statuses recorded) Jan 22 03:05:53.097: INFO: Container metrics-server ready: true, restart count 0 Jan 22 03:05:53.097: INFO: Container metrics-server-nanny ready: true, restart count 0 Jan 22 03:05:53.097: INFO: coredns-6954c77b9b-7rkd6 started at 2021-01-22 02:11:34 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:53.097: INFO: Container coredns ready: true, restart count 0 W0122 03:05:53.142491 68129 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:05:53.381: INFO: Latency metrics for node e2e-84b410effb-9cdc3-minion-group-7b60 Jan 22 03:05:53.381: INFO: Logging node info for node e2e-84b410effb-9cdc3-minion-group-pqjj Jan 22 03:05:53.418: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-minion-group-pqjj b394e111-171e-41ab-88f5-665f81cd77b8 9810 0 2021-01-22 02:11:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-minion-group-pqjj kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-minion-group-pqjj"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 02:11:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-22 02:11:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-22 02:45:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 02:50:25 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-minion-group-pqjj,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-22 03:01:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-22 03:01:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-22 03:01:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-22 03:01:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-22 03:01:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-22 03:01:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-22 03:01:26 +0000 UTC,LastTransitionTime:2021-01-22 02:11:19 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:11:16 +0000 UTC,LastTransitionTime:2021-01-22 02:11:16 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:01:27 +0000 UTC,LastTransitionTime:2021-01-22 02:11:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:01:27 +0000 UTC,LastTransitionTime:2021-01-22 02:11:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:01:27 +0000 UTC,LastTransitionTime:2021-01-22 02:11:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:01:27 +0000 UTC,LastTransitionTime:2021-01-22 02:11:26 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.6,},NodeAddress{Type:ExternalIP,Address:35.233.209.181,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-minion-group-pqjj.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-minion-group-pqjj.c.k8s-jkns-gci-gce-flaky.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69dde29e3ff2b59d8dd7d53f7b31018e,SystemUUID:69dde29e-3ff2-b59d-8dd7-d53f7b31018e,BootID:d14f3b11-55a8-40dd-be51-2aa20b9d88ba,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.246_f8ca5ad18a2452],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:70314658,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:a494ff6ec10e05a454458fbf44247d93c9b3a0d983a00b538e442f353b7030c8 k8s.gcr.io/sig-storage/snapshot-controller:v3.0.2],SizeBytes:17461280,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 03:05:53.419: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-minion-group-pqjj Jan 22 03:05:53.457: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-minion-group-pqjj Jan 22 03:05:53.541: INFO: l7-default-backend-6dd8477499-sm248 started at 2021-01-22 02:11:28 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:53.541: INFO: Container default-http-backend ready: true, restart count 0 Jan 22 03:05:53.541: INFO: kube-dns-autoscaler-76478fcf46-k8z99 started at 2021-01-22 02:11:30 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:53.541: INFO: Container autoscaler ready: true, restart count 0 Jan 22 03:05:53.541: INFO: coredns-6954c77b9b-wxkj2 started at 2021-01-22 02:11:33 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:53.541: INFO: Container coredns ready: true, restart count 0 Jan 22 03:05:53.541: INFO: volume-snapshot-controller-0 started at 2021-01-22 02:11:34 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:53.541: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jan 22 03:05:53.541: INFO: csi-gce-pd-node-kvhv5 started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:05:53.541: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:05:53.541: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 03:05:53.541: INFO: kube-proxy-e2e-84b410effb-9cdc3-minion-group-pqjj started at 2021-01-22 02:11:16 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:53.541: INFO: Container kube-proxy ready: true, restart count 0 Jan 22 03:05:53.541: INFO: metadata-proxy-v0.1-g59g4 started at 2021-01-22 02:11:16 +0000 UTC (0+2 container statuses recorded) Jan 22 03:05:53.541: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 03:05:53.541: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 W0122 03:05:53.583398 68129 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:05:53.783: INFO: Latency metrics for node e2e-84b410effb-9cdc3-minion-group-pqjj Jan 22 03:05:53.783: INFO: Logging node info for node e2e-84b410effb-9cdc3-windows-node-group-fwqs Jan 22 03:05:53.820: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-windows-node-group-fwqs 03ada1ed-2848-4578-b26b-3409d84a67a7 10966 0 2021-01-22 02:13:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-windows-node-group-fwqs kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-windows-node-group-fwqs"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-22 02:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-22 02:56:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-windows-node-group-fwqs,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:13:42 +0000 UTC,LastTransitionTime:2021-01-22 02:13:42 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:05:08 +0000 UTC,LastTransitionTime:2021-01-22 02:13:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:05:08 +0000 UTC,LastTransitionTime:2021-01-22 02:13:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:05:08 +0000 UTC,LastTransitionTime:2021-01-22 02:13:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:05:08 +0000 UTC,LastTransitionTime:2021-01-22 02:13:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.230.36.104,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-windows-node-group-fwqs.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-windows-node-group-fwqs,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-84b410effb-9cdc3-windows-node-group-fwqs,SystemUUID:2605E1CF-F954-B8A7-C371-67879EA3A75A,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-1e6e8911-0537-4e28-bcf3-3d59a245baa6 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-d3fb5599-fb6d-4177-a80c-0927cb4af253],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-d3fb5599-fb6d-4177-a80c-0927cb4af253,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-1e6e8911-0537-4e28-bcf3-3d59a245baa6,DevicePath:,},},Config:nil,},} Jan 22 03:05:53.820: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-windows-node-group-fwqs Jan 22 03:05:53.857: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-windows-node-group-fwqs Jan 22 03:05:54.053: INFO: csi-gce-pd-node-win-qkss4 started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:05:54.054: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:05:54.054: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 03:05:54.054: INFO: pod-subpath-test-dynamicpv-hnpz started at 2021-01-22 03:04:55 +0000 UTC (1+2 container statuses recorded) Jan 22 03:05:54.054: INFO: Init container test-init-subpath-dynamicpv-hnpz ready: false, restart count 0 Jan 22 03:05:54.054: INFO: Container test-container-subpath-dynamicpv-hnpz ready: false, restart count 0 Jan 22 03:05:54.054: INFO: Container test-container-volume-dynamicpv-hnpz ready: false, restart count 0 Jan 22 03:05:54.054: INFO: external-client started at 2021-01-22 03:05:05 +0000 UTC (0+1 container statuses recorded) Jan 22 03:05:54.054: INFO: Container external-client ready: false, restart count 0 W0122 03:05:54.096576 68129 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:05:57.525: INFO: Latency metrics for node e2e-84b410effb-9cdc3-windows-node-group-fwqs Jan 22 03:05:57.525: INFO: Logging node info for node e2e-84b410effb-9cdc3-windows-node-group-jw99 Jan 22 03:05:57.562: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-windows-node-group-jw99 904a9c2a-6648-4d9f-a11e-49987deab805 10661 0 2021-01-22 02:13:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-windows-node-group-jw99 kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-windows-node-group-jw99"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-22 02:50:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-22 02:51:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-windows-node-group-jw99,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:13:45 +0000 UTC,LastTransitionTime:2021-01-22 02:13:45 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:04:20 +0000 UTC,LastTransitionTime:2021-01-22 02:13:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:04:20 +0000 UTC,LastTransitionTime:2021-01-22 02:13:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:04:20 +0000 UTC,LastTransitionTime:2021-01-22 02:13:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:04:20 +0000 UTC,LastTransitionTime:2021-01-22 02:13:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.135.248,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-windows-node-group-jw99.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-windows-node-group-jw99,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-84b410effb-9cdc3-windows-node-group-jw99,SystemUUID:6AD86565-A22D-BC4E-82AA-6E80BE66D591,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-a111a63b-15eb-40dc-b19e-029dabd3ca95 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-b8e4eea5-c434-463b-b612-63e9d1d8c4fc kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-d9711ff8-3a02-438b-aa93-1bf356503444],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-a111a63b-15eb-40dc-b19e-029dabd3ca95,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-b8e4eea5-c434-463b-b612-63e9d1d8c4fc,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-d9711ff8-3a02-438b-aa93-1bf356503444,DevicePath:,},},Config:nil,},} Jan 22 03:05:57.563: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-windows-node-group-jw99 Jan 22 03:05:57.600: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-windows-node-group-jw99 Jan 22 03:05:57.695: INFO: pod-subpath-test-dynamicpv-8gck started at 2021-01-22 03:04:19 +0000 UTC (2+2 container statuses recorded) Jan 22 03:05:57.695: INFO: Init container init-volume-dynamicpv-8gck ready: true, restart count 0 Jan 22 03:05:57.695: INFO: Init container test-init-subpath-dynamicpv-8gck ready: false, restart count 0 Jan 22 03:05:57.695: INFO: Container test-container-subpath-dynamicpv-8gck ready: false, restart count 0 Jan 22 03:05:57.695: INFO: Container test-container-volume-dynamicpv-8gck ready: false, restart count 0 Jan 22 03:05:57.695: INFO: csi-gce-pd-node-win-pqp9m started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:05:57.695: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:05:57.695: INFO: Container gce-pd-driver ready: true, restart count 0 W0122 03:05:57.734865 68129 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:06:04.725: INFO: Latency metrics for node e2e-84b410effb-9cdc3-windows-node-group-jw99 Jan 22 03:06:04.725: INFO: Logging node info for node e2e-84b410effb-9cdc3-windows-node-group-m1w4 Jan 22 03:06:04.762: INFO: Node Info: &Node{ObjectMeta:{e2e-84b410effb-9cdc3-windows-node-group-m1w4 57b62334-4ffe-4ed3-b22b-65c09d81b6a3 11071 0 2021-01-22 02:13:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-84b410effb-9cdc3-windows-node-group-m1w4 kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/instances/e2e-84b410effb-9cdc3-windows-node-group-m1w4"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-22 02:54:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-22 02:54:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-flaky/us-west1-b/e2e-84b410effb-9cdc3-windows-node-group-m1w4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 02:13:57 +0000 UTC,LastTransitionTime:2021-01-22 02:13:57 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 03:05:52 +0000 UTC,LastTransitionTime:2021-01-22 02:13:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 03:05:52 +0000 UTC,LastTransitionTime:2021-01-22 02:13:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 03:05:52 +0000 UTC,LastTransitionTime:2021-01-22 02:13:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 03:05:52 +0000 UTC,LastTransitionTime:2021-01-22 02:14:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.14.136,},NodeAddress{Type:InternalDNS,Address:e2e-84b410effb-9cdc3-windows-node-group-m1w4.c.k8s-jkns-gci-gce-flaky.internal,},NodeAddress{Type:Hostname,Address:e2e-84b410effb-9cdc3-windows-node-group-m1w4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-84b410effb-9cdc3-windows-node-group-m1w4,SystemUUID:408F617E-C42C-A098-944F-74104283C0D5,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,KubeProxyVersion:v1.21.0-alpha.1.246+f8ca5ad18a2452,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver@sha256:8f031881a2850786ac5f31229c24315c61d7ac700691382f2ec02bf007609bb5 gcr.io/k8s-jkns-gci-gce-flaky/gcp-persistent-disk-csi-driver:a131eb0b-a914-432e-ae43-e73131e6b3ad],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-6a3137e6-8a6f-4e9f-b2e7-abbb80ddfea1 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-b8e4eea5-c434-463b-b612-63e9d1d8c4fc],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-flaky/zones/us-west1-b/disks/pvc-6a3137e6-8a6f-4e9f-b2e7-abbb80ddfea1,DevicePath:,},},Config:nil,},} Jan 22 03:06:04.762: INFO: Logging kubelet events for node e2e-84b410effb-9cdc3-windows-node-group-m1w4 Jan 22 03:06:04.801: INFO: Logging pods the kubelet thinks is on node e2e-84b410effb-9cdc3-windows-node-group-m1w4 Jan 22 03:06:04.881: INFO: csi-gce-pd-node-win-z5jkt started at 2021-01-22 02:45:44 +0000 UTC (0+2 container statuses recorded) Jan 22 03:06:04.881: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 03:06:04.881: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 03:06:04.881: INFO: pod-subpath-test-dynamicpv-5gns started at 2021-01-22 03:04:11 +0000 UTC (1+2 container statuses recorded) Jan 22 03:06:04.881: INFO: Init container init-volume-dynamicpv-5gns ready: true, restart count 0 Jan 22 03:06:04.881: INFO: Container test-container-subpath-dynamicpv-5gns ready: true, restart count 0 Jan 22 03:06:04.881: INFO: Container test-container-volume-dynamicpv-5gns ready: true, restart count 0 Jan 22 03:06:04.881: INFO: pvc-snapshottable-data-tester-87bsp started at 2021-01-22 03:05:50 +0000 UTC (0+1 container statuses recorded) Jan 22 03:06:04.881: INFO: Container volume-tester ready: false, restart count 0 W0122 03:06:04.926846 68129 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 03:06:06.351: INFO: Latency metrics for node e2e-84b410effb-9cdc3-windows-node-group-m1w4 Jan 22 03:06:06.351: INFO: Waiting up to 3m0s for all (but 3) nodes to be ready �[1mSTEP�[0m: Destroying namespace "snapshotting-4461" for this suite.
Filter through log files | View test history on testgrid
Check APIReachability
Deferred TearDown
DumpClusterLogs
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion
Extract
TearDown
TearDown Previous
Timeout
Up
diffResources
list nodes
listResources After
listResources Before
listResources Down
listResources Up
test setup
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail in binding dynamic provisioned PV to PVC [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (delayed binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (immediate binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][sig-windows] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][sig-windows] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable-stress[Feature:VolumeSnapshotDataSource] should support snapshotting of many volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable-stress[Feature:VolumeSnapshotDataSource] should support snapshotting of many volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (xfs)][Slow] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to create pod by failing to mount volume [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should store data