Recent runs || View in Spyglass
Result | FAILURE |
Tests | 3 failed / 42 succeeded |
Started | |
Elapsed | 1h18m |
Revision | master |
job-version | v1.21.0-alpha.1.281+7f033ea142efda |
revision | v1.21.0-alpha.1.281+7f033ea142efda |
error during /home/prow/go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver/test/run-windows-k8s-integration.sh: exit status 255
from junit_runner.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=External\sStorage\s\[Driver\:\scsi\-gcepd\-sc\-windows\]\s\[Testpattern\:\sDynamic\sSnapshot\s\(retain\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion$'
/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 Jan 24 07:10:15.898: Unexpected error: <*errors.errorString | 0xc0033043e0>: { s: "Failed to find \"hello from snapshotting-9572 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-9572 namespace", last result: "���������������������������������������� " occurred /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268from junit_pdcsi.xml
[BeforeEach] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 24 07:03:01.084: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] volume snapshot controller /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:176 Jan 24 07:03:01.279: INFO: Creating resource for dynamic PV Jan 24 07:03:01.279: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-9572-e2e-scqq9tf �[1mSTEP�[0m: creating a claim Jan 24 07:03:01.317: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: starting a pod to use the claim Jan 24 07:03:01.432: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-8hv9b" in namespace "snapshotting-9572" to be "Succeeded or Failed" Jan 24 07:03:01.468: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 35.695596ms Jan 24 07:03:03.504: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071961318s Jan 24 07:03:05.649: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 4.21667051s Jan 24 07:03:07.690: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 6.257836554s Jan 24 07:03:09.726: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 8.294099356s Jan 24 07:03:11.763: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 10.330620547s Jan 24 07:03:13.799: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 12.366518572s Jan 24 07:03:15.837: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 14.404293619s Jan 24 07:03:17.875: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 16.442601297s Jan 24 07:03:19.929: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 18.496648899s Jan 24 07:03:21.965: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 20.532858868s Jan 24 07:03:24.001: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 22.569003011s Jan 24 07:03:26.039: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 24.606518857s Jan 24 07:03:28.075: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 26.64286593s Jan 24 07:03:30.112: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 28.679817825s Jan 24 07:03:32.150: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 30.717238887s Jan 24 07:03:34.187: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 32.754198935s Jan 24 07:03:36.223: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 34.791006085s Jan 24 07:03:38.260: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 36.828112917s Jan 24 07:03:40.297: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 38.865100723s Jan 24 07:03:42.334: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 40.901621227s Jan 24 07:03:44.370: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 42.937659408s Jan 24 07:03:46.406: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 44.973865998s Jan 24 07:03:48.443: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 47.010928668s Jan 24 07:03:50.481: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 49.04858463s Jan 24 07:03:52.518: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 51.085585696s Jan 24 07:03:54.554: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 53.122155198s Jan 24 07:03:56.592: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 55.160121166s Jan 24 07:03:58.630: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 57.19750893s Jan 24 07:04:00.667: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 59.234815067s Jan 24 07:04:02.706: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.273307077s Jan 24 07:04:04.743: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.310315145s Jan 24 07:04:06.779: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.346809253s Jan 24 07:04:08.816: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.384048231s Jan 24 07:04:10.853: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.420861648s Jan 24 07:04:12.890: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.457751504s Jan 24 07:04:14.928: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.495284242s Jan 24 07:04:16.965: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.532731652s Jan 24 07:04:19.003: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.570482289s Jan 24 07:04:21.040: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.607548816s Jan 24 07:04:23.077: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.644407771s Jan 24 07:04:25.113: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.680916628s Jan 24 07:04:27.150: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.717641017s Jan 24 07:04:29.187: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.754669032s Jan 24 07:04:31.224: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.79148715s Jan 24 07:04:33.260: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.827741647s Jan 24 07:04:35.297: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.864234209s Jan 24 07:04:37.335: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m35.902796272s Jan 24 07:04:39.373: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.940533038s Jan 24 07:04:41.410: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m39.97794467s Jan 24 07:04:43.448: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.015197833s Jan 24 07:04:45.488: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.055915196s Jan 24 07:04:47.527: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.094249809s Jan 24 07:04:49.563: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.130988691s Jan 24 07:04:51.600: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.167334463s Jan 24 07:04:53.636: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.203416549s Jan 24 07:04:55.673: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.240212463s Jan 24 07:04:57.710: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.277866774s Jan 24 07:04:59.749: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.316470436s Jan 24 07:05:01.786: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.353569357s Jan 24 07:05:03.824: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.391410288s Jan 24 07:05:05.861: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.428404928s Jan 24 07:05:07.898: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.465408843s Jan 24 07:05:09.934: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.501532575s Jan 24 07:05:11.970: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.537558866s Jan 24 07:05:14.006: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.574059378s Jan 24 07:05:16.044: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.611202807s Jan 24 07:05:18.084: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.651784432s Jan 24 07:05:20.121: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.688881652s Jan 24 07:05:22.158: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.725828498s Jan 24 07:05:24.195: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.762201289s Jan 24 07:05:26.231: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.798841305s Jan 24 07:05:28.268: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.835682647s Jan 24 07:05:30.305: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.872429607s Jan 24 07:05:32.344: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.911797065s Jan 24 07:05:34.381: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.948246292s Jan 24 07:05:36.418: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.985826239s Jan 24 07:05:38.454: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m37.021969254s Jan 24 07:05:40.491: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m39.058494926s Jan 24 07:05:42.526: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Running", Reason="", readiness=true. Elapsed: 2m41.094010168s Jan 24 07:05:44.570: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Running", Reason="", readiness=true. Elapsed: 2m43.13804189s Jan 24 07:05:46.607: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Running", Reason="", readiness=true. Elapsed: 2m45.175143259s Jan 24 07:05:48.644: INFO: Pod "pvc-snapshottable-tester-8hv9b": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2m47.211252937s �[1mSTEP�[0m: Saw pod success Jan 24 07:05:48.644: INFO: Pod "pvc-snapshottable-tester-8hv9b" satisfied condition "Succeeded or Failed" Jan 24 07:05:48.854: INFO: Pod pvc-snapshottable-tester-8hv9b has the following logs: Jan 24 07:05:48.854: INFO: Deleting pod "pvc-snapshottable-tester-8hv9b" in namespace "snapshotting-9572" Jan 24 07:05:48.902: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-8hv9b" to be fully deleted Jan 24 07:05:48.940: INFO: Waiting up to 5m0s for PersistentVolumeClaims [csi-gcepd-sc-windowsvcknk] to have phase Bound Jan 24 07:05:48.976: INFO: PersistentVolumeClaim csi-gcepd-sc-windowsvcknk found and phase=Bound (35.80031ms) �[1mSTEP�[0m: checking the claim �[1mSTEP�[0m: checking the PV [BeforeEach] /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:190 �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jan 24 07:05:49.185: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-xppgs to become ready Jan 24 07:05:49.227: INFO: VolumeSnapshot snapshot-xppgs found but is not ready. Jan 24 07:05:51.265: INFO: VolumeSnapshot snapshot-xppgs found but is not ready. Jan 24 07:05:53.302: INFO: VolumeSnapshot snapshot-xppgs found but is not ready. Jan 24 07:05:55.339: INFO: VolumeSnapshot snapshot-xppgs found but is not ready. Jan 24 07:05:57.376: INFO: VolumeSnapshot snapshot-xppgs found but is not ready. Jan 24 07:05:59.415: INFO: VolumeSnapshot snapshot-xppgs found but is not ready. Jan 24 07:06:01.468: INFO: VolumeSnapshot snapshot-xppgs found but is not ready. Jan 24 07:06:03.506: INFO: VolumeSnapshot snapshot-xppgs found but is not ready. Jan 24 07:06:05.544: INFO: VolumeSnapshot snapshot-xppgs found but is not ready. Jan 24 07:06:07.587: INFO: VolumeSnapshot snapshot-xppgs found and is ready Jan 24 07:06:07.587: INFO: WaitUntil finished successfully after 18.402212648s Jan 24 07:06:07.624: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-9b933313-d1db-496b-b004-8059fe2421c4 creationTime:2021-01-24T07:05:50Z readyToUse:true restoreSize:5Gi] Jan 24 07:06:07.624: INFO: snapshotContentName snapcontent-9b933313-d1db-496b-b004-8059fe2421c4 [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: Modifying source data test �[1mSTEP�[0m: modifying the data in the source PVC Jan 24 07:06:07.773: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-flt74" in namespace "snapshotting-9572" to be "Succeeded or Failed" Jan 24 07:06:07.808: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 35.121706ms Jan 24 07:06:09.846: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 2.072771376s Jan 24 07:06:11.882: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 4.109448482s Jan 24 07:06:13.921: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 6.1482096s Jan 24 07:06:15.957: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 8.184589784s Jan 24 07:06:17.994: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 10.221426635s Jan 24 07:06:20.031: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 12.258122812s Jan 24 07:06:22.067: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 14.294587515s Jan 24 07:06:24.104: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 16.330952613s Jan 24 07:06:26.148: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 18.375228758s Jan 24 07:06:28.185: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 20.412052846s Jan 24 07:06:30.221: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 22.448396933s Jan 24 07:06:32.258: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 24.484646832s Jan 24 07:06:34.295: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 26.521794186s Jan 24 07:06:36.331: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 28.557908104s Jan 24 07:06:38.369: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 30.596565322s Jan 24 07:06:40.407: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 32.633803976s Jan 24 07:06:42.443: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 34.670056386s Jan 24 07:06:44.483: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 36.709876734s Jan 24 07:06:46.519: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 38.746052681s Jan 24 07:06:48.555: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 40.782338142s Jan 24 07:06:50.593: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 42.820039032s Jan 24 07:06:52.632: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 44.858987166s Jan 24 07:06:54.676: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 46.903532759s Jan 24 07:06:56.713: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 48.940336382s Jan 24 07:06:58.752: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 50.979238623s Jan 24 07:07:00.789: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 53.016389796s Jan 24 07:07:02.826: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 55.053209838s Jan 24 07:07:04.868: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 57.095304354s Jan 24 07:07:06.946: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 59.173189983s Jan 24 07:07:08.984: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.210801616s Jan 24 07:07:11.022: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.248815233s Jan 24 07:07:13.057: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.284603921s Jan 24 07:07:15.094: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.321405544s Jan 24 07:07:17.134: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.36107276s Jan 24 07:07:19.171: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.397953593s Jan 24 07:07:21.207: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Running", Reason="", readiness=true. Elapsed: 1m13.43417137s Jan 24 07:07:23.244: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Running", Reason="", readiness=true. Elapsed: 1m15.470815482s Jan 24 07:07:25.280: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Running", Reason="", readiness=true. Elapsed: 1m17.507554054s Jan 24 07:07:27.348: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Running", Reason="", readiness=true. Elapsed: 1m19.575138055s Jan 24 07:07:29.385: INFO: Pod "pvc-snapshottable-data-tester-flt74": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m21.61173917s �[1mSTEP�[0m: Saw pod success Jan 24 07:07:29.385: INFO: Pod "pvc-snapshottable-data-tester-flt74" satisfied condition "Succeeded or Failed" Jan 24 07:07:29.724: INFO: Pod pvc-snapshottable-data-tester-flt74 has the following logs: Jan 24 07:07:29.724: INFO: Deleting pod "pvc-snapshottable-data-tester-flt74" in namespace "snapshotting-9572" Jan 24 07:07:29.773: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-flt74" to be fully deleted �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the claim Jan 24 07:09:13.974: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:09:16.893: INFO: stderr: "" Jan 24 07:09:16.893: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:09:18.893: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:09:20.749: INFO: stderr: "" Jan 24 07:09:20.749: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:09:22.749: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:09:25.647: INFO: stderr: "" Jan 24 07:09:25.647: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:09:27.647: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:09:30.921: INFO: stderr: "" Jan 24 07:09:30.921: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:09:32.922: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:09:33.993: INFO: stderr: "" Jan 24 07:09:33.993: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:09:35.993: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:09:37.101: INFO: stderr: "" Jan 24 07:09:37.101: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:09:39.101: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:09:40.586: INFO: stderr: "" Jan 24 07:09:40.586: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:09:42.586: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:09:43.984: INFO: stderr: "" Jan 24 07:09:43.984: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:09:45.984: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:09:47.381: INFO: stderr: "" Jan 24 07:09:47.381: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:09:49.381: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:09:50.711: INFO: stderr: "" Jan 24 07:09:50.711: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:09:52.711: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:09:56.775: INFO: stderr: "" Jan 24 07:09:56.775: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:09:58.776: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:10:00.279: INFO: stderr: "" Jan 24 07:10:00.279: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:10:02.279: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:10:03.705: INFO: stderr: "" Jan 24 07:10:03.705: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:10:05.706: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:10:07.021: INFO: stderr: "" Jan 24 07:10:07.021: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:10:09.022: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:10:10.412: INFO: stderr: "" Jan 24 07:10:10.412: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:10:12.413: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-9572 exec restored-pvc-tester-lvgws --namespace=snapshotting-9572 -- powershell /c type /mnt/test/data' Jan 24 07:10:13.897: INFO: stderr: "" Jan 24 07:10:13.897: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:10:15.898: FAIL: Unexpected error: <*errors.errorString | 0xc0033043e0>: { s: "Failed to find \"hello from snapshotting-9572 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-9572 namespace", last result: "���������������������������������������� " occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.5.2() /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268 +0x1254 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001382480) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc001382480) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc001382480, 0x4ff25b0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] volume snapshot controller /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:179 Jan 24 07:10:15.942: INFO: Pod restored-pvc-tester-lvgws has the following logs: Jan 24 07:10:15.942: INFO: Deleting pod "restored-pvc-tester-lvgws" in namespace "snapshotting-9572" Jan 24 07:10:15.994: INFO: Wait up to 5m0s for pod "restored-pvc-tester-lvgws" to be fully deleted Jan 24 07:10:26.069: INFO: deleting claim "snapshotting-9572"/"pvc-6bkfp" Jan 24 07:10:26.106: INFO: deleting snapshot "snapshotting-9572"/"snapshot-xppgs" Jan 24 07:10:26.142: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-9b933313-d1db-496b-b004-8059fe2421c4 creationTime:2021-01-24T07:05:50Z readyToUse:true restoreSize:5Gi] Jan 24 07:10:26.142: INFO: snapshotContentName snapcontent-9b933313-d1db-496b-b004-8059fe2421c4 Jan 24 07:10:26.261: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-9b933313-d1db-496b-b004-8059fe2421c4 to be deleted Jan 24 07:10:26.300: INFO: volumesnapshotcontents snapcontent-9b933313-d1db-496b-b004-8059fe2421c4 has been found and is not deleted Jan 24 07:10:28.338: INFO: volumesnapshotcontents snapcontent-9b933313-d1db-496b-b004-8059fe2421c4 has been found and is not deleted Jan 24 07:10:30.375: INFO: volumesnapshotcontents snapcontent-9b933313-d1db-496b-b004-8059fe2421c4 has been found and is not deleted Jan 24 07:10:32.413: INFO: volumesnapshotcontents snapcontent-9b933313-d1db-496b-b004-8059fe2421c4 has been found and is not deleted Jan 24 07:10:34.450: INFO: volumesnapshotcontents snapcontent-9b933313-d1db-496b-b004-8059fe2421c4 is not found and has been deleted Jan 24 07:10:34.450: INFO: WaitUntil finished successfully after 8.189066718s Jan 24 07:10:34.450: INFO: deleting snapshot content "snapcontent-9b933313-d1db-496b-b004-8059fe2421c4" Jan 24 07:10:34.487: INFO: deleting snapshot class "snapshotting-9572-vscqvqbt" Jan 24 07:10:34.533: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-9572-vscqvqbt to be deleted Jan 24 07:10:34.570: INFO: volumesnapshotclasses snapshotting-9572-vscqvqbt is not found and has been deleted Jan 24 07:10:34.570: INFO: WaitUntil finished successfully after 36.2816ms �[1mSTEP�[0m: Deleting pvc Jan 24 07:10:34.642: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windowsvcknk" Jan 24 07:10:34.683: INFO: Waiting up to 5m0s for PersistentVolume pvc-56dff470-3bb0-4c9a-9634-07c28ebcaeb5 to get deleted Jan 24 07:10:34.721: INFO: PersistentVolume pvc-56dff470-3bb0-4c9a-9634-07c28ebcaeb5 found and phase=Released (37.774358ms) Jan 24 07:10:39.759: INFO: PersistentVolume pvc-56dff470-3bb0-4c9a-9634-07c28ebcaeb5 was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-9572". �[1mSTEP�[0m: Found 27 events. Jan 24 07:10:39.840: INFO: At 2021-01-24 07:03:01 +0000 UTC - event for csi-gcepd-sc-windowsvcknk: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 24 07:10:39.840: INFO: At 2021-01-24 07:03:01 +0000 UTC - event for csi-gcepd-sc-windowsvcknk: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 24 07:10:39.840: INFO: At 2021-01-24 07:03:01 +0000 UTC - event for csi-gcepd-sc-windowsvcknk: {pd.csi.storage.gke.io_e2e-fd6004bb2a-9cdc3-minion-group-jczt_b9fcde89-40b8-481d-b708-dc9700b81b23 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-9572/csi-gcepd-sc-windowsvcknk" Jan 24 07:10:39.840: INFO: At 2021-01-24 07:03:05 +0000 UTC - event for csi-gcepd-sc-windowsvcknk: {pd.csi.storage.gke.io_e2e-fd6004bb2a-9cdc3-minion-group-jczt_b9fcde89-40b8-481d-b708-dc9700b81b23 } ProvisioningSucceeded: Successfully provisioned volume pvc-56dff470-3bb0-4c9a-9634-07c28ebcaeb5 Jan 24 07:10:39.840: INFO: At 2021-01-24 07:03:05 +0000 UTC - event for pvc-snapshottable-tester-8hv9b: {default-scheduler } Scheduled: Successfully assigned snapshotting-9572/pvc-snapshottable-tester-8hv9b to e2e-fd6004bb2a-9cdc3-windows-node-group-00qx Jan 24 07:10:39.840: INFO: At 2021-01-24 07:03:17 +0000 UTC - event for pvc-snapshottable-tester-8hv9b: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-56dff470-3bb0-4c9a-9634-07c28ebcaeb5" Jan 24 07:10:39.840: INFO: At 2021-01-24 07:04:59 +0000 UTC - event for pvc-snapshottable-tester-8hv9b: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-00qx} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.26" Jan 24 07:10:39.840: INFO: At 2021-01-24 07:05:30 +0000 UTC - event for pvc-snapshottable-tester-8hv9b: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-00qx} Created: Created container volume-tester Jan 24 07:10:39.840: INFO: At 2021-01-24 07:05:30 +0000 UTC - event for pvc-snapshottable-tester-8hv9b: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-00qx} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.26" in 31.1972874s Jan 24 07:10:39.840: INFO: At 2021-01-24 07:05:36 +0000 UTC - event for pvc-snapshottable-tester-8hv9b: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-00qx} Started: Started container volume-tester Jan 24 07:10:39.840: INFO: At 2021-01-24 07:05:49 +0000 UTC - event for snapshot-xppgs: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-9572/snapshot-xppgs to be created by the CSI driver. Jan 24 07:10:39.840: INFO: At 2021-01-24 07:06:07 +0000 UTC - event for pvc-snapshottable-data-tester-flt74: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-56dff470-3bb0-4c9a-9634-07c28ebcaeb5" Volume is already exclusively attached to one node and can't be attached to another Jan 24 07:10:39.840: INFO: At 2021-01-24 07:06:07 +0000 UTC - event for pvc-snapshottable-data-tester-flt74: {default-scheduler } Scheduled: Successfully assigned snapshotting-9572/pvc-snapshottable-data-tester-flt74 to e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:10:39.840: INFO: At 2021-01-24 07:06:26 +0000 UTC - event for pvc-snapshottable-data-tester-flt74: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-56dff470-3bb0-4c9a-9634-07c28ebcaeb5" Jan 24 07:10:39.840: INFO: At 2021-01-24 07:07:13 +0000 UTC - event for pvc-snapshottable-data-tester-flt74: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 24 07:10:39.840: INFO: At 2021-01-24 07:07:13 +0000 UTC - event for pvc-snapshottable-data-tester-flt74: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Created: Created container volume-tester Jan 24 07:10:39.840: INFO: At 2021-01-24 07:07:15 +0000 UTC - event for pvc-snapshottable-data-tester-flt74: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Started: Started container volume-tester Jan 24 07:10:39.840: INFO: At 2021-01-24 07:07:29 +0000 UTC - event for pvc-6bkfp: {pd.csi.storage.gke.io_e2e-fd6004bb2a-9cdc3-minion-group-jczt_b9fcde89-40b8-481d-b708-dc9700b81b23 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-9572/pvc-6bkfp" Jan 24 07:10:39.840: INFO: At 2021-01-24 07:07:29 +0000 UTC - event for pvc-6bkfp: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 24 07:10:39.840: INFO: At 2021-01-24 07:07:29 +0000 UTC - event for pvc-6bkfp: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 24 07:10:39.840: INFO: At 2021-01-24 07:07:51 +0000 UTC - event for pvc-6bkfp: {pd.csi.storage.gke.io_e2e-fd6004bb2a-9cdc3-minion-group-jczt_b9fcde89-40b8-481d-b708-dc9700b81b23 } ProvisioningSucceeded: Successfully provisioned volume pvc-95161eb5-ea77-4af6-9784-40b925b2712c Jan 24 07:10:39.840: INFO: At 2021-01-24 07:07:51 +0000 UTC - event for restored-pvc-tester-lvgws: {default-scheduler } Scheduled: Successfully assigned snapshotting-9572/restored-pvc-tester-lvgws to e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:10:39.840: INFO: At 2021-01-24 07:08:00 +0000 UTC - event for restored-pvc-tester-lvgws: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-95161eb5-ea77-4af6-9784-40b925b2712c" Jan 24 07:10:39.840: INFO: At 2021-01-24 07:08:57 +0000 UTC - event for restored-pvc-tester-lvgws: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 24 07:10:39.840: INFO: At 2021-01-24 07:08:57 +0000 UTC - event for restored-pvc-tester-lvgws: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Created: Created container volume-tester Jan 24 07:10:39.840: INFO: At 2021-01-24 07:08:59 +0000 UTC - event for restored-pvc-tester-lvgws: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Started: Started container volume-tester Jan 24 07:10:39.840: INFO: At 2021-01-24 07:10:15 +0000 UTC - event for restored-pvc-tester-lvgws: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Killing: Stopping container volume-tester Jan 24 07:10:39.876: INFO: POD NODE PHASE GRACE CONDITIONS Jan 24 07:10:39.876: INFO: Jan 24 07:10:39.923: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-master Jan 24 07:10:39.961: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-master 804c9f69-d998-471d-9e8a-f5ecfb8f907a 8171 0 2021-01-24 06:23:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-24 06:23:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2021-01-24 06:58:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-24 07:02:38 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3866861568 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3604717568 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:23:59 +0000 UTC,LastTransitionTime:2021-01-24 06:23:59 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:09:07 +0000 UTC,LastTransitionTime:2021-01-24 06:23:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:09:07 +0000 UTC,LastTransitionTime:2021-01-24 06:23:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:09:07 +0000 UTC,LastTransitionTime:2021-01-24 06:23:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:09:07 +0000 UTC,LastTransitionTime:2021-01-24 06:24:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.105.95.168,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-master.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-master.c.k8s-jkns-e2e-gke-ubuntu.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6925b73d3906893a46cd1284a5804db2,SystemUUID:6925b73d-3906-893a-46cd-1284a5804db2,BootID:41ede1fd-84a5-4549-9c02-2536a3111388,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.21.0-alpha.1.281_7f033ea142efda],SizeBytes:123005230,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.21.0-alpha.1.281_7f033ea142efda],SizeBytes:117528904,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:70314507,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.21.0-alpha.1.281_7f033ea142efda],SizeBytes:47716663,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 24 07:10:39.962: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-master Jan 24 07:10:40.001: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-master Jan 24 07:10:40.054: INFO: csi-gce-pd-node-wwwlj started at 2021-01-24 06:58:20 +0000 UTC (0+2 container statuses recorded) Jan 24 07:10:40.054: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:10:40.054: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:10:40.054: INFO: kube-controller-manager-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:21:56 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:40.054: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 24 07:10:40.054: INFO: kube-scheduler-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:22:06 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:40.054: INFO: Container kube-scheduler ready: true, restart count 0 Jan 24 07:10:40.054: INFO: etcd-server-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:22:26 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:40.054: INFO: Container etcd-container ready: true, restart count 0 Jan 24 07:10:40.054: INFO: kube-apiserver-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:22:36 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:40.054: INFO: Container kube-apiserver ready: true, restart count 0 Jan 24 07:10:40.054: INFO: kube-addon-manager-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:23:24 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:40.054: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 24 07:10:40.054: INFO: l7-lb-controller-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:24:19 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:40.054: INFO: Container l7-lb-controller ready: true, restart count 1 Jan 24 07:10:40.054: INFO: metadata-proxy-v0.1-s94xp started at 2021-01-24 06:24:19 +0000 UTC (0+2 container statuses recorded) Jan 24 07:10:40.054: INFO: Container metadata-proxy ready: true, restart count 0 Jan 24 07:10:40.054: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 24 07:10:40.054: INFO: etcd-server-events-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:22:16 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:40.054: INFO: Container etcd-container ready: true, restart count 0 W0124 07:10:40.128617 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:10:40.518: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-master Jan 24 07:10:40.518: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-minion-group-326l Jan 24 07:10:40.557: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-minion-group-326l 613f601e-35b2-4d96-98c4-f77ef755acbd 8323 0 2021-01-24 06:24:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-minion-group-326l kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-minion-group-326l"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-24 06:24:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-24 06:24:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-24 06:58:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-24 07:02:39 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-minion-group-326l,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-24 07:09:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-24 07:09:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-24 07:09:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-24 07:09:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-24 07:09:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-24 07:09:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-24 07:09:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:24:22 +0000 UTC,LastTransitionTime:2021-01-24 06:24:22 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:08:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:08:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:08:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:08:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.7,},NodeAddress{Type:ExternalIP,Address:34.105.96.236,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-minion-group-326l.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-minion-group-326l.c.k8s-jkns-e2e-gke-ubuntu.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:917bc389d3d7b5935b91863e3e0dc07c,SystemUUID:917bc389-d3d7-b593-5b91-863e3e0dc07c,BootID:0c9087be-592f-4d6a-93d9-8d85240ca574,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.281_7f033ea142efda],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:70314507,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:a494ff6ec10e05a454458fbf44247d93c9b3a0d983a00b538e442f353b7030c8 k8s.gcr.io/sig-storage/snapshot-controller:v3.0.2],SizeBytes:17461280,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 24 07:10:40.558: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-minion-group-326l Jan 24 07:10:40.599: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-minion-group-326l Jan 24 07:10:40.670: INFO: volume-snapshot-controller-0 started at 2021-01-24 06:24:39 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:40.670: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jan 24 07:10:40.670: INFO: csi-gce-pd-node-4s522 started at 2021-01-24 06:58:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:10:40.670: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:10:40.670: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:10:40.670: INFO: kube-proxy-e2e-fd6004bb2a-9cdc3-minion-group-326l started at 2021-01-24 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:40.670: INFO: Container kube-proxy ready: true, restart count 0 Jan 24 07:10:40.670: INFO: metadata-proxy-v0.1-lmc4m started at 2021-01-24 06:24:22 +0000 UTC (0+2 container statuses recorded) Jan 24 07:10:40.670: INFO: Container metadata-proxy ready: true, restart count 0 Jan 24 07:10:40.670: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 24 07:10:40.670: INFO: l7-default-backend-6dd8477499-vwxmn started at 2021-01-24 06:24:35 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:40.670: INFO: Container default-http-backend ready: true, restart count 0 Jan 24 07:10:40.670: INFO: coredns-6954c77b9b-g9wl9 started at 2021-01-24 06:24:36 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:40.670: INFO: Container coredns ready: true, restart count 0 W0124 07:10:40.718616 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:10:40.915: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-minion-group-326l Jan 24 07:10:40.915: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-minion-group-jczt Jan 24 07:10:40.953: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-minion-group-jczt db0b09ad-c4f5-4658-baf7-f9a06abea181 8318 0 2021-01-24 06:24:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-minion-group-jczt kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-minion-group-jczt"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-24 06:24:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.5.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-24 06:24:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-24 06:58:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-24 07:02:39 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.5.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-minion-group-jczt,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.5.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-24 07:09:31 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-24 07:09:31 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-24 07:09:31 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-24 07:09:31 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-24 07:09:31 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-24 07:09:31 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-24 07:09:31 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:24:21 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:08:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:08:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:08:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:08:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:31 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.6,},NodeAddress{Type:ExternalIP,Address:35.247.54.152,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-minion-group-jczt.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-minion-group-jczt.c.k8s-jkns-e2e-gke-ubuntu.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:78731c26804cca6e18934a1bb4eb5305,SystemUUID:78731c26-804c-ca6e-1893-4a1bb4eb5305,BootID:d2fd27ad-96ae-4ae9-b5df-886f63448173,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.281_7f033ea142efda],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:70314507,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:bec571992d40203edcd056ac0b0d97003887ee5e4be144c41932d18639673b03 k8s.gcr.io/sig-storage/csi-provisioner:v2.0.4],SizeBytes:20428748,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:e5ce22ddc2a6fbc9b5729dbcfaf1159c4b0d48dad62ddd1b93503c1348e4a406 k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.1],SizeBytes:19498883,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:ca160717df7f6b7964c936faf608b914f2277363e6d708ea2e2dbbf2c5f56a83 k8s.gcr.io/sig-storage/csi-resizer:v1.0.1],SizeBytes:19463877,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:7495d30800fb3ef22f3dc6d5fe9a0a6ec40ba32a2bdc0cf5e7fcaa507adc921e k8s.gcr.io/sig-storage/csi-attacher:v3.0.1],SizeBytes:19460260,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 24 07:10:40.953: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-minion-group-jczt Jan 24 07:10:40.993: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-minion-group-jczt Jan 24 07:10:41.056: INFO: csi-gce-pd-controller-67cd645885-h2psn started at 2021-01-24 06:58:20 +0000 UTC (0+5 container statuses recorded) Jan 24 07:10:41.056: INFO: Container csi-attacher ready: true, restart count 0 Jan 24 07:10:41.056: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 07:10:41.056: INFO: Container csi-resizer ready: true, restart count 0 Jan 24 07:10:41.056: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 24 07:10:41.056: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:10:41.056: INFO: csi-gce-pd-node-rqsvb started at 2021-01-24 06:58:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:10:41.056: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:10:41.056: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:10:41.056: INFO: kube-proxy-e2e-fd6004bb2a-9cdc3-minion-group-jczt started at 2021-01-24 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:41.056: INFO: Container kube-proxy ready: true, restart count 0 Jan 24 07:10:41.056: INFO: metadata-proxy-v0.1-9xllr started at 2021-01-24 06:24:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:10:41.056: INFO: Container metadata-proxy ready: true, restart count 0 Jan 24 07:10:41.056: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 24 07:10:41.057: INFO: coredns-6954c77b9b-w6tw6 started at 2021-01-24 06:24:32 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:41.057: INFO: Container coredns ready: true, restart count 0 Jan 24 07:10:41.057: INFO: kube-dns-autoscaler-76478fcf46-knm95 started at 2021-01-24 06:24:32 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:41.057: INFO: Container autoscaler ready: true, restart count 0 Jan 24 07:10:41.057: INFO: metrics-server-v0.3.6-8b98f98c9-zv9nj started at 2021-01-24 06:25:47 +0000 UTC (0+2 container statuses recorded) Jan 24 07:10:41.057: INFO: Container metrics-server ready: true, restart count 0 Jan 24 07:10:41.057: INFO: Container metrics-server-nanny ready: true, restart count 0 W0124 07:10:41.179012 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:10:41.421: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-minion-group-jczt Jan 24 07:10:41.421: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-windows-node-group-00qx Jan 24 07:10:41.458: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-windows-node-group-00qx 5ed0daf7-7850-46a8-a847-4a9f888fe7e6 8665 0 2021-01-24 06:28:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-windows-node-group-00qx kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-windows-node-group-00qx"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-24 07:03:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-24 07:03:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-windows-node-group-00qx,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:28:13 +0000 UTC,LastTransitionTime:2021-01-24 06:28:13 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:10:38 +0000 UTC,LastTransitionTime:2021-01-24 06:28:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:10:38 +0000 UTC,LastTransitionTime:2021-01-24 06:28:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:10:38 +0000 UTC,LastTransitionTime:2021-01-24 06:28:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:10:38 +0000 UTC,LastTransitionTime:2021-01-24 06:28:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.233.40,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-00qx.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-00qx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-fd6004bb2a-9cdc3-windows-node-group-00qx,SystemUUID:B696F087-B1F3-E973-A95C-45B15D9F46F4,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-6d956ad0-b13b-4083-844b-ea5a9e9b3b5b kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-cb2d72b2-f7a8-4a0b-b81e-f6ba12e17253],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-6d956ad0-b13b-4083-844b-ea5a9e9b3b5b,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-cb2d72b2-f7a8-4a0b-b81e-f6ba12e17253,DevicePath:,},},Config:nil,},} Jan 24 07:10:41.459: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-windows-node-group-00qx Jan 24 07:10:41.497: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-windows-node-group-00qx Jan 24 07:10:41.552: INFO: csi-gce-pd-node-win-4zmh5 started at 2021-01-24 06:58:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:10:41.552: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:10:41.552: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:10:41.552: INFO: pod-2374cbb2-3986-4802-9187-f5aefaf11d3f started at 2021-01-24 07:10:15 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:41.552: INFO: Container write-pod ready: false, restart count 0 Jan 24 07:10:41.552: INFO: exec-volume-test-dynamicpv-b8f8 started at 2021-01-24 07:10:26 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:41.552: INFO: Container exec-container-dynamicpv-b8f8 ready: false, restart count 0 W0124 07:10:41.597291 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:10:45.401: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-windows-node-group-00qx Jan 24 07:10:45.401: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:10:45.439: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 611bbb19-0cca-4ca9-a790-28232fedc41e 8339 0 2021-01-24 06:27:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-windows-node-group-08j6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-24 07:03:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-24 07:06:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-windows-node-group-08j6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:27:59 +0000 UTC,LastTransitionTime:2021-01-24 06:27:59 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:09:36 +0000 UTC,LastTransitionTime:2021-01-24 06:27:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:09:36 +0000 UTC,LastTransitionTime:2021-01-24 06:27:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:09:36 +0000 UTC,LastTransitionTime:2021-01-24 06:27:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:09:36 +0000 UTC,LastTransitionTime:2021-01-24 06:28:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.83.246.182,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-08j6.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-08j6,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-fd6004bb2a-9cdc3-windows-node-group-08j6,SystemUUID:F89ED870-C6C5-2F35-433C-064895727A0B,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-37216239-3c5d-4ebf-8781-001cd30f38d5 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-95161eb5-ea77-4af6-9784-40b925b2712c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-37216239-3c5d-4ebf-8781-001cd30f38d5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-95161eb5-ea77-4af6-9784-40b925b2712c,DevicePath:,},},Config:nil,},} Jan 24 07:10:45.439: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:10:45.488: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:10:45.529: INFO: csi-gce-pd-node-win-2j485 started at 2021-01-24 06:58:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:10:45.529: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:10:45.529: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:10:45.529: INFO: pod-subpath-test-dynamicpv-ltms started at 2021-01-24 07:09:26 +0000 UTC (1+1 container statuses recorded) Jan 24 07:10:45.529: INFO: Init container init-volume-dynamicpv-ltms ready: true, restart count 0 Jan 24 07:10:45.529: INFO: Container test-container-subpath-dynamicpv-ltms ready: false, restart count 0 W0124 07:10:45.576842 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:10:46.104: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:10:46.104: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h Jan 24 07:10:46.140: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h a64dce98-2636-4d0e-8807-ce37fa7594d1 8537 0 2021-01-24 06:28:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-24 07:03:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-24 07:03:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:28:31 +0000 UTC,LastTransitionTime:2021-01-24 06:28:31 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:10:08 +0000 UTC,LastTransitionTime:2021-01-24 06:28:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:10:08 +0000 UTC,LastTransitionTime:2021-01-24 06:28:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:10:08 +0000 UTC,LastTransitionTime:2021-01-24 06:28:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:10:08 +0000 UTC,LastTransitionTime:2021-01-24 06:28:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.166.247,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h,SystemUUID:A002E2FF-3952-75AC-4ED7-1635A3A547CF,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-190ea814-1152-4173-bc99-4f3a7873a1bd kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-e1cdc9db-4a59-452e-ae6f-ff19d3bc0239],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-e1cdc9db-4a59-452e-ae6f-ff19d3bc0239,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-190ea814-1152-4173-bc99-4f3a7873a1bd,DevicePath:,},},Config:nil,},} Jan 24 07:10:46.140: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h Jan 24 07:10:46.181: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h Jan 24 07:10:46.232: INFO: csi-gce-pd-node-win-jcn62 started at 2021-01-24 06:58:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:10:46.232: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:10:46.232: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:10:46.232: INFO: external-client started at 2021-01-24 07:09:56 +0000 UTC (0+1 container statuses recorded) Jan 24 07:10:46.232: INFO: Container external-client ready: true, restart count 0 Jan 24 07:10:46.232: INFO: pod-subpath-test-dynamicpv-l4rf started at 2021-01-24 07:10:07 +0000 UTC (1+2 container statuses recorded) Jan 24 07:10:46.232: INFO: Init container init-volume-dynamicpv-l4rf ready: false, restart count 0 Jan 24 07:10:46.232: INFO: Container test-container-subpath-dynamicpv-l4rf ready: false, restart count 0 Jan 24 07:10:46.232: INFO: Container test-container-volume-dynamicpv-l4rf ready: false, restart count 0 W0124 07:10:46.278330 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:10:47.055: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h Jan 24 07:10:47.055: INFO: Waiting up to 3m0s for all (but 3) nodes to be ready �[1mSTEP�[0m: Destroying namespace "snapshotting-9572" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=External\sStorage\s\[Driver\:\scsi\-gcepd\-sc\-windows\]\s\[Testpattern\:\sPre\-provisioned\sSnapshot\s\(retain\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion$'
/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 Jan 24 07:16:03.264: Unexpected error: <*errors.errorString | 0xc003d2c670>: { s: "Failed to find \"hello from snapshotting-2925 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-2925 namespace", last result: "���������������������������������������� " occurred /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268from junit_pdcsi.xml
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 24 07:10:47.329: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] volume snapshot controller /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:176 Jan 24 07:10:47.567: INFO: Creating resource for dynamic PV Jan 24 07:10:47.567: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-2925-e2e-sckjxbp �[1mSTEP�[0m: creating a claim Jan 24 07:10:47.606: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: starting a pod to use the claim Jan 24 07:10:47.723: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-nzgh8" in namespace "snapshotting-2925" to be "Succeeded or Failed" Jan 24 07:10:47.759: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 36.328236ms Jan 24 07:10:49.798: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.075473181s Jan 24 07:10:51.839: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.11650413s Jan 24 07:10:53.876: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.152815116s Jan 24 07:10:55.915: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.191656851s Jan 24 07:10:57.951: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.228391101s Jan 24 07:10:59.989: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 12.265851243s Jan 24 07:11:02.027: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 14.304311434s Jan 24 07:11:04.064: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 16.341294434s Jan 24 07:11:06.101: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 18.378240193s Jan 24 07:11:08.208: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 20.484872417s Jan 24 07:11:10.244: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 22.521501218s Jan 24 07:11:12.281: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 24.558169292s Jan 24 07:11:14.318: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 26.595287156s Jan 24 07:11:16.355: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 28.632231661s Jan 24 07:11:18.392: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 30.669253977s Jan 24 07:11:20.430: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 32.706724811s Jan 24 07:11:22.466: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 34.743261816s Jan 24 07:11:24.503: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 36.780525376s Jan 24 07:11:26.540: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 38.817121546s Jan 24 07:11:28.577: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 40.853843229s Jan 24 07:11:30.613: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 42.890321727s Jan 24 07:11:32.651: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 44.928146949s Jan 24 07:11:34.691: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 46.968504673s Jan 24 07:11:36.729: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 49.005747562s Jan 24 07:11:38.765: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 51.042141258s Jan 24 07:11:40.815: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 53.09172743s Jan 24 07:11:42.851: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 55.12791147s Jan 24 07:11:44.888: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 57.165072862s Jan 24 07:11:46.925: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 59.201933894s Jan 24 07:11:48.988: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.265402462s Jan 24 07:11:51.025: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.302456108s Jan 24 07:11:53.062: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.339131153s Jan 24 07:11:55.099: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.375849069s Jan 24 07:11:57.136: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.412736203s Jan 24 07:11:59.173: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.449644864s Jan 24 07:12:01.211: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.488370309s Jan 24 07:12:03.248: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.524627896s Jan 24 07:12:05.284: INFO: Pod "pvc-snapshottable-tester-nzgh8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m17.56153435s �[1mSTEP�[0m: Saw pod success Jan 24 07:12:05.284: INFO: Pod "pvc-snapshottable-tester-nzgh8" satisfied condition "Succeeded or Failed" Jan 24 07:12:05.378: INFO: Pod pvc-snapshottable-tester-nzgh8 has the following logs: Jan 24 07:12:05.378: INFO: Deleting pod "pvc-snapshottable-tester-nzgh8" in namespace "snapshotting-2925" Jan 24 07:12:05.466: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-nzgh8" to be fully deleted Jan 24 07:12:05.503: INFO: Waiting up to 5m0s for PersistentVolumeClaims [csi-gcepd-sc-windowsk9v92] to have phase Bound Jan 24 07:12:05.540: INFO: PersistentVolumeClaim csi-gcepd-sc-windowsk9v92 found and phase=Bound (36.736809ms) �[1mSTEP�[0m: checking the claim �[1mSTEP�[0m: checking the PV [BeforeEach] /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:190 �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jan 24 07:12:05.738: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-5zj5q to become ready Jan 24 07:12:05.782: INFO: VolumeSnapshot snapshot-5zj5q found but is not ready. Jan 24 07:12:07.820: INFO: VolumeSnapshot snapshot-5zj5q found but is not ready. Jan 24 07:12:09.857: INFO: VolumeSnapshot snapshot-5zj5q found but is not ready. Jan 24 07:12:11.895: INFO: VolumeSnapshot snapshot-5zj5q found but is not ready. Jan 24 07:12:13.932: INFO: VolumeSnapshot snapshot-5zj5q found but is not ready. Jan 24 07:12:15.970: INFO: VolumeSnapshot snapshot-5zj5q found but is not ready. Jan 24 07:12:18.007: INFO: VolumeSnapshot snapshot-5zj5q found but is not ready. Jan 24 07:12:20.044: INFO: VolumeSnapshot snapshot-5zj5q found but is not ready. Jan 24 07:12:22.081: INFO: VolumeSnapshot snapshot-5zj5q found but is not ready. Jan 24 07:12:24.119: INFO: VolumeSnapshot snapshot-5zj5q found and is ready Jan 24 07:12:24.119: INFO: WaitUntil finished successfully after 18.380474034s Jan 24 07:12:24.156: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-83344c5a-fdd6-4698-bd49-84b547e2ecfe creationTime:2021-01-24T07:12:06Z readyToUse:true restoreSize:5Gi] Jan 24 07:12:24.156: INFO: snapshotContentName snapcontent-83344c5a-fdd6-4698-bd49-84b547e2ecfe �[1mSTEP�[0m: updating the snapshot content deletion policy to retain �[1mSTEP�[0m: recording the volume handle and snapshotHandle Jan 24 07:12:24.236: INFO: Recording snapshot handle: projects/k8s-jkns-e2e-gke-ubuntu/global/snapshots/snapshot-83344c5a-fdd6-4698-bd49-84b547e2ecfe �[1mSTEP�[0m: deleting the snapshot and snapshot content �[1mSTEP�[0m: checking the Snapshot has been deleted Jan 24 07:12:24.279: INFO: Waiting up to 5m0s for volumesnapshots snapshotting-2925 to be deleted Jan 24 07:12:24.316: INFO: volumesnapshots snapshotting-2925 is not found in namespace snapshot-5zj5q and has been deleted Jan 24 07:12:24.316: INFO: WaitUntil finished successfully after 37.035883ms �[1mSTEP�[0m: checking the Snapshot content has been deleted Jan 24 07:12:24.359: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-83344c5a-fdd6-4698-bd49-84b547e2ecfe to be deleted Jan 24 07:12:24.396: INFO: volumesnapshotcontents snapcontent-83344c5a-fdd6-4698-bd49-84b547e2ecfe is not found and has been deleted Jan 24 07:12:24.396: INFO: WaitUntil finished successfully after 36.971572ms �[1mSTEP�[0m: creating a snapshot content with the snapshot handle �[1mSTEP�[0m: creating a snapshot with that snapshot content Jan 24 07:12:24.476: INFO: Waiting up to 5m0s for VolumeSnapshot pre-provisioned-snapshot-54f1e8fe-e04e-4ef0-8657-c9897c8a647d to become ready Jan 24 07:12:24.517: INFO: VolumeSnapshot pre-provisioned-snapshot-54f1e8fe-e04e-4ef0-8657-c9897c8a647d found but is not ready. Jan 24 07:12:26.553: INFO: VolumeSnapshot pre-provisioned-snapshot-54f1e8fe-e04e-4ef0-8657-c9897c8a647d found and is ready Jan 24 07:12:26.553: INFO: WaitUntil finished successfully after 2.077021572s �[1mSTEP�[0m: getting the snapshot and snapshot content [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: Modifying source data test �[1mSTEP�[0m: modifying the data in the source PVC Jan 24 07:12:26.738: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-c82fb" in namespace "snapshotting-2925" to be "Succeeded or Failed" Jan 24 07:12:26.776: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 38.485784ms Jan 24 07:12:28.813: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.074821685s Jan 24 07:12:30.849: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 4.111325924s Jan 24 07:12:32.886: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 6.148370068s Jan 24 07:12:34.923: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 8.185064293s Jan 24 07:12:36.960: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 10.221925795s Jan 24 07:12:39.001: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 12.262721456s Jan 24 07:12:41.037: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 14.299126453s Jan 24 07:12:43.074: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 16.335694866s Jan 24 07:12:45.110: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 18.372195296s Jan 24 07:12:47.147: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 20.408818894s Jan 24 07:12:49.184: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 22.445764673s Jan 24 07:12:51.220: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 24.481972372s Jan 24 07:12:53.257: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 26.518752429s Jan 24 07:12:55.292: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 28.554461026s Jan 24 07:12:57.329: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 30.591477726s Jan 24 07:12:59.366: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 32.627935377s Jan 24 07:13:01.403: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 34.665011672s Jan 24 07:13:03.440: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 36.702611711s Jan 24 07:13:05.477: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 38.739033447s Jan 24 07:13:07.517: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 40.779513588s Jan 24 07:13:09.554: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 42.816426668s Jan 24 07:13:11.592: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 44.854257306s Jan 24 07:13:13.629: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 46.890931391s Jan 24 07:13:15.667: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 48.928685228s Jan 24 07:13:17.704: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 50.966573971s Jan 24 07:13:19.744: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 53.00585708s Jan 24 07:13:21.801: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 55.063618347s Jan 24 07:13:23.838: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 57.10057454s Jan 24 07:13:25.881: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 59.143517512s Jan 24 07:13:27.930: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.192148492s Jan 24 07:13:29.970: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.232422733s Jan 24 07:13:32.008: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.270288488s Jan 24 07:13:34.058: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.319857367s Jan 24 07:13:36.095: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Running", Reason="", readiness=true. Elapsed: 1m9.356737749s Jan 24 07:13:38.135: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Running", Reason="", readiness=true. Elapsed: 1m11.397285856s Jan 24 07:13:40.172: INFO: Pod "pvc-snapshottable-data-tester-c82fb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m13.433844372s �[1mSTEP�[0m: Saw pod success Jan 24 07:13:40.172: INFO: Pod "pvc-snapshottable-data-tester-c82fb" satisfied condition "Succeeded or Failed" Jan 24 07:13:40.257: INFO: Pod pvc-snapshottable-data-tester-c82fb has the following logs: Jan 24 07:13:40.257: INFO: Deleting pod "pvc-snapshottable-data-tester-c82fb" in namespace "snapshotting-2925" Jan 24 07:13:40.309: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-c82fb" to be fully deleted �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the claim Jan 24 07:15:00.560: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:02.077: INFO: stderr: "" Jan 24 07:15:02.077: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:04.078: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:05.775: INFO: stderr: "" Jan 24 07:15:05.775: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:07.776: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:08.782: INFO: stderr: "" Jan 24 07:15:08.782: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:10.783: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:12.115: INFO: stderr: "" Jan 24 07:15:12.115: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:14.115: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:15.341: INFO: stderr: "" Jan 24 07:15:15.341: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:17.341: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:19.486: INFO: stderr: "" Jan 24 07:15:19.486: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:21.487: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:22.683: INFO: stderr: "" Jan 24 07:15:22.683: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:24.683: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:25.918: INFO: stderr: "" Jan 24 07:15:25.918: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:27.919: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:29.198: INFO: stderr: "" Jan 24 07:15:29.198: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:31.199: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:33.776: INFO: stderr: "" Jan 24 07:15:33.776: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:35.776: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:36.928: INFO: stderr: "" Jan 24 07:15:36.928: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:38.929: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:40.522: INFO: stderr: "" Jan 24 07:15:40.522: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:42.522: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:43.745: INFO: stderr: "" Jan 24 07:15:43.745: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:45.745: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:47.450: INFO: stderr: "" Jan 24 07:15:47.450: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:49.451: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:50.827: INFO: stderr: "" Jan 24 07:15:50.827: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:52.827: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:54.209: INFO: stderr: "" Jan 24 07:15:54.209: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:56.209: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:15:57.416: INFO: stderr: "" Jan 24 07:15:57.416: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:15:59.416: INFO: Running '/tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/bin/kubectl --server=https://34.105.95.168 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-2925 exec restored-pvc-tester-2xgzq --namespace=snapshotting-2925 -- powershell /c type /mnt/test/data' Jan 24 07:16:01.263: INFO: stderr: "" Jan 24 07:16:01.263: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 24 07:16:03.264: FAIL: Unexpected error: <*errors.errorString | 0xc003d2c670>: { s: "Failed to find \"hello from snapshotting-2925 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-2925 namespace", last result: "���������������������������������������� " occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.5.2() /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268 +0x1254 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001382480) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc001382480) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc001382480, 0x4ff25b0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] volume snapshot controller /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:179 Jan 24 07:16:03.316: INFO: Pod restored-pvc-tester-2xgzq has the following logs: Jan 24 07:16:03.316: INFO: Deleting pod "restored-pvc-tester-2xgzq" in namespace "snapshotting-2925" Jan 24 07:16:03.355: INFO: Wait up to 5m0s for pod "restored-pvc-tester-2xgzq" to be fully deleted Jan 24 07:16:07.427: INFO: deleting claim "snapshotting-2925"/"pvc-lqftd" Jan 24 07:16:07.486: INFO: deleting snapshot "snapshotting-2925"/"pre-provisioned-snapshot-54f1e8fe-e04e-4ef0-8657-c9897c8a647d" Jan 24 07:16:07.530: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:pre-provisioned-snapcontent-54f1e8fe-e04e-4ef0-8657-c9897c8a647d creationTime:2021-01-24T07:12:06Z readyToUse:true restoreSize:5Gi] Jan 24 07:16:07.530: INFO: snapshotContentName pre-provisioned-snapcontent-54f1e8fe-e04e-4ef0-8657-c9897c8a647d Jan 24 07:16:07.681: INFO: Waiting up to 5m0s for volumesnapshotcontents pre-provisioned-snapcontent-54f1e8fe-e04e-4ef0-8657-c9897c8a647d to be deleted Jan 24 07:16:07.721: INFO: volumesnapshotcontents pre-provisioned-snapcontent-54f1e8fe-e04e-4ef0-8657-c9897c8a647d has been found and is not deleted Jan 24 07:16:09.759: INFO: volumesnapshotcontents pre-provisioned-snapcontent-54f1e8fe-e04e-4ef0-8657-c9897c8a647d has been found and is not deleted Jan 24 07:16:11.797: INFO: volumesnapshotcontents pre-provisioned-snapcontent-54f1e8fe-e04e-4ef0-8657-c9897c8a647d has been found and is not deleted Jan 24 07:16:13.833: INFO: volumesnapshotcontents pre-provisioned-snapcontent-54f1e8fe-e04e-4ef0-8657-c9897c8a647d has been found and is not deleted Jan 24 07:16:15.870: INFO: volumesnapshotcontents pre-provisioned-snapcontent-54f1e8fe-e04e-4ef0-8657-c9897c8a647d is not found and has been deleted Jan 24 07:16:15.870: INFO: WaitUntil finished successfully after 8.188654272s Jan 24 07:16:15.870: INFO: deleting snapshot content "pre-provisioned-snapcontent-54f1e8fe-e04e-4ef0-8657-c9897c8a647d" Jan 24 07:16:15.906: INFO: deleting snapshot class "snapshotting-2925-vsc2ztzx" Jan 24 07:16:15.946: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-2925-vsc2ztzx to be deleted Jan 24 07:16:15.983: INFO: volumesnapshotclasses snapshotting-2925-vsc2ztzx is not found and has been deleted Jan 24 07:16:15.983: INFO: WaitUntil finished successfully after 36.210306ms �[1mSTEP�[0m: Deleting pvc Jan 24 07:16:16.063: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windowsk9v92" Jan 24 07:16:16.102: INFO: Waiting up to 5m0s for PersistentVolume pvc-4f12608d-77ea-40a0-81fe-8bdeb7982470 to get deleted Jan 24 07:16:16.137: INFO: PersistentVolume pvc-4f12608d-77ea-40a0-81fe-8bdeb7982470 found and phase=Released (35.632042ms) Jan 24 07:16:21.174: INFO: PersistentVolume pvc-4f12608d-77ea-40a0-81fe-8bdeb7982470 was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp430784301/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-2925". �[1mSTEP�[0m: Found 24 events. Jan 24 07:16:21.254: INFO: At 2021-01-24 07:10:47 +0000 UTC - event for csi-gcepd-sc-windowsk9v92: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 24 07:16:21.254: INFO: At 2021-01-24 07:10:47 +0000 UTC - event for csi-gcepd-sc-windowsk9v92: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 24 07:16:21.254: INFO: At 2021-01-24 07:10:47 +0000 UTC - event for csi-gcepd-sc-windowsk9v92: {pd.csi.storage.gke.io_e2e-fd6004bb2a-9cdc3-minion-group-jczt_b9fcde89-40b8-481d-b708-dc9700b81b23 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-2925/csi-gcepd-sc-windowsk9v92" Jan 24 07:16:21.254: INFO: At 2021-01-24 07:10:51 +0000 UTC - event for csi-gcepd-sc-windowsk9v92: {pd.csi.storage.gke.io_e2e-fd6004bb2a-9cdc3-minion-group-jczt_b9fcde89-40b8-481d-b708-dc9700b81b23 } ProvisioningSucceeded: Successfully provisioned volume pvc-4f12608d-77ea-40a0-81fe-8bdeb7982470 Jan 24 07:16:21.254: INFO: At 2021-01-24 07:10:51 +0000 UTC - event for pvc-snapshottable-tester-nzgh8: {default-scheduler } Scheduled: Successfully assigned snapshotting-2925/pvc-snapshottable-tester-nzgh8 to e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:16:21.254: INFO: At 2021-01-24 07:11:00 +0000 UTC - event for pvc-snapshottable-tester-nzgh8: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-4f12608d-77ea-40a0-81fe-8bdeb7982470" Jan 24 07:16:21.254: INFO: At 2021-01-24 07:11:49 +0000 UTC - event for pvc-snapshottable-tester-nzgh8: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Created: Created container volume-tester Jan 24 07:16:21.254: INFO: At 2021-01-24 07:11:49 +0000 UTC - event for pvc-snapshottable-tester-nzgh8: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 24 07:16:21.254: INFO: At 2021-01-24 07:11:52 +0000 UTC - event for pvc-snapshottable-tester-nzgh8: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Started: Started container volume-tester Jan 24 07:16:21.254: INFO: At 2021-01-24 07:12:05 +0000 UTC - event for snapshot-5zj5q: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-2925/snapshot-5zj5q to be created by the CSI driver. Jan 24 07:16:21.254: INFO: At 2021-01-24 07:12:26 +0000 UTC - event for pvc-snapshottable-data-tester-c82fb: {default-scheduler } Scheduled: Successfully assigned snapshotting-2925/pvc-snapshottable-data-tester-c82fb to e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:16:21.254: INFO: At 2021-01-24 07:13:27 +0000 UTC - event for pvc-snapshottable-data-tester-c82fb: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 24 07:16:21.254: INFO: At 2021-01-24 07:13:27 +0000 UTC - event for pvc-snapshottable-data-tester-c82fb: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Created: Created container volume-tester Jan 24 07:16:21.254: INFO: At 2021-01-24 07:13:29 +0000 UTC - event for pvc-snapshottable-data-tester-c82fb: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-08j6} Started: Started container volume-tester Jan 24 07:16:21.254: INFO: At 2021-01-24 07:13:40 +0000 UTC - event for pvc-lqftd: {pd.csi.storage.gke.io_e2e-fd6004bb2a-9cdc3-minion-group-jczt_b9fcde89-40b8-481d-b708-dc9700b81b23 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-2925/pvc-lqftd" Jan 24 07:16:21.254: INFO: At 2021-01-24 07:13:40 +0000 UTC - event for pvc-lqftd: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 24 07:16:21.254: INFO: At 2021-01-24 07:13:40 +0000 UTC - event for pvc-lqftd: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 24 07:16:21.254: INFO: At 2021-01-24 07:14:02 +0000 UTC - event for pvc-lqftd: {pd.csi.storage.gke.io_e2e-fd6004bb2a-9cdc3-minion-group-jczt_b9fcde89-40b8-481d-b708-dc9700b81b23 } ProvisioningSucceeded: Successfully provisioned volume pvc-1f33bf56-60c0-4a3f-a7a9-3f8d16f4e165 Jan 24 07:16:21.254: INFO: At 2021-01-24 07:14:03 +0000 UTC - event for restored-pvc-tester-2xgzq: {default-scheduler } Scheduled: Successfully assigned snapshotting-2925/restored-pvc-tester-2xgzq to e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h Jan 24 07:16:21.254: INFO: At 2021-01-24 07:14:12 +0000 UTC - event for restored-pvc-tester-2xgzq: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-1f33bf56-60c0-4a3f-a7a9-3f8d16f4e165" Jan 24 07:16:21.254: INFO: At 2021-01-24 07:14:53 +0000 UTC - event for restored-pvc-tester-2xgzq: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 24 07:16:21.254: INFO: At 2021-01-24 07:14:53 +0000 UTC - event for restored-pvc-tester-2xgzq: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h} Created: Created container volume-tester Jan 24 07:16:21.254: INFO: At 2021-01-24 07:14:54 +0000 UTC - event for restored-pvc-tester-2xgzq: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h} Started: Started container volume-tester Jan 24 07:16:21.254: INFO: At 2021-01-24 07:16:03 +0000 UTC - event for restored-pvc-tester-2xgzq: {kubelet e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h} Killing: Stopping container volume-tester Jan 24 07:16:21.290: INFO: POD NODE PHASE GRACE CONDITIONS Jan 24 07:16:21.290: INFO: Jan 24 07:16:21.331: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-master Jan 24 07:16:21.369: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-master 804c9f69-d998-471d-9e8a-f5ecfb8f907a 9860 0 2021-01-24 06:23:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-24 06:23:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2021-01-24 06:58:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-24 07:02:38 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3866861568 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3604717568 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:23:59 +0000 UTC,LastTransitionTime:2021-01-24 06:23:59 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:14:08 +0000 UTC,LastTransitionTime:2021-01-24 06:23:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:14:08 +0000 UTC,LastTransitionTime:2021-01-24 06:23:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:14:08 +0000 UTC,LastTransitionTime:2021-01-24 06:23:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:14:08 +0000 UTC,LastTransitionTime:2021-01-24 06:24:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.105.95.168,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-master.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-master.c.k8s-jkns-e2e-gke-ubuntu.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6925b73d3906893a46cd1284a5804db2,SystemUUID:6925b73d-3906-893a-46cd-1284a5804db2,BootID:41ede1fd-84a5-4549-9c02-2536a3111388,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.21.0-alpha.1.281_7f033ea142efda],SizeBytes:123005230,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.21.0-alpha.1.281_7f033ea142efda],SizeBytes:117528904,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:70314507,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.21.0-alpha.1.281_7f033ea142efda],SizeBytes:47716663,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 24 07:16:21.369: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-master Jan 24 07:16:21.409: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-master Jan 24 07:16:21.451: INFO: kube-scheduler-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:22:06 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:21.451: INFO: Container kube-scheduler ready: true, restart count 0 Jan 24 07:16:21.451: INFO: etcd-server-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:22:26 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:21.451: INFO: Container etcd-container ready: true, restart count 0 Jan 24 07:16:21.451: INFO: kube-apiserver-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:22:36 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:21.451: INFO: Container kube-apiserver ready: true, restart count 0 Jan 24 07:16:21.451: INFO: kube-addon-manager-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:23:24 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:21.451: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 24 07:16:21.452: INFO: l7-lb-controller-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:24:19 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:21.452: INFO: Container l7-lb-controller ready: true, restart count 1 Jan 24 07:16:21.452: INFO: metadata-proxy-v0.1-s94xp started at 2021-01-24 06:24:19 +0000 UTC (0+2 container statuses recorded) Jan 24 07:16:21.452: INFO: Container metadata-proxy ready: true, restart count 0 Jan 24 07:16:21.452: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 24 07:16:21.452: INFO: csi-gce-pd-node-wwwlj started at 2021-01-24 06:58:20 +0000 UTC (0+2 container statuses recorded) Jan 24 07:16:21.452: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:16:21.452: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:16:21.452: INFO: kube-controller-manager-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:21:56 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:21.452: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 24 07:16:21.452: INFO: etcd-server-events-e2e-fd6004bb2a-9cdc3-master started at 2021-01-24 06:22:16 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:21.452: INFO: Container etcd-container ready: true, restart count 0 W0124 07:16:21.501649 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:16:21.837: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-master Jan 24 07:16:21.837: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-minion-group-326l Jan 24 07:16:21.875: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-minion-group-326l 613f601e-35b2-4d96-98c4-f77ef755acbd 9959 0 2021-01-24 06:24:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-minion-group-326l kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-minion-group-326l"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-24 06:24:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-24 06:24:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-24 06:58:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-24 07:02:39 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-minion-group-326l,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:24 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:24:22 +0000 UTC,LastTransitionTime:2021-01-24 06:24:22 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:13:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:13:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:13:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:13:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.7,},NodeAddress{Type:ExternalIP,Address:34.105.96.236,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-minion-group-326l.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-minion-group-326l.c.k8s-jkns-e2e-gke-ubuntu.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:917bc389d3d7b5935b91863e3e0dc07c,SystemUUID:917bc389-d3d7-b593-5b91-863e3e0dc07c,BootID:0c9087be-592f-4d6a-93d9-8d85240ca574,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.281_7f033ea142efda],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:70314507,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:a494ff6ec10e05a454458fbf44247d93c9b3a0d983a00b538e442f353b7030c8 k8s.gcr.io/sig-storage/snapshot-controller:v3.0.2],SizeBytes:17461280,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 24 07:16:21.875: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-minion-group-326l Jan 24 07:16:21.917: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-minion-group-326l Jan 24 07:16:21.977: INFO: kube-proxy-e2e-fd6004bb2a-9cdc3-minion-group-326l started at 2021-01-24 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:21.977: INFO: Container kube-proxy ready: true, restart count 0 Jan 24 07:16:21.977: INFO: metadata-proxy-v0.1-lmc4m started at 2021-01-24 06:24:22 +0000 UTC (0+2 container statuses recorded) Jan 24 07:16:21.977: INFO: Container metadata-proxy ready: true, restart count 0 Jan 24 07:16:21.977: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 24 07:16:21.977: INFO: l7-default-backend-6dd8477499-vwxmn started at 2021-01-24 06:24:35 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:21.977: INFO: Container default-http-backend ready: true, restart count 0 Jan 24 07:16:21.977: INFO: coredns-6954c77b9b-g9wl9 started at 2021-01-24 06:24:36 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:21.977: INFO: Container coredns ready: true, restart count 0 Jan 24 07:16:21.977: INFO: volume-snapshot-controller-0 started at 2021-01-24 06:24:39 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:21.977: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jan 24 07:16:21.977: INFO: csi-gce-pd-node-4s522 started at 2021-01-24 06:58:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:16:21.977: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:16:21.977: INFO: Container gce-pd-driver ready: true, restart count 0 W0124 07:16:22.021950 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:16:22.203: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-minion-group-326l Jan 24 07:16:22.203: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-minion-group-jczt Jan 24 07:16:22.240: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-minion-group-jczt db0b09ad-c4f5-4658-baf7-f9a06abea181 9958 0 2021-01-24 06:24:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-minion-group-jczt kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-minion-group-jczt"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-24 06:24:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.5.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-24 06:24:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-24 06:58:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-24 07:02:39 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.5.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-minion-group-jczt,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.5.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-24 07:14:32 +0000 UTC,LastTransitionTime:2021-01-24 06:24:25 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:24:21 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:13:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:13:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:13:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:13:57 +0000 UTC,LastTransitionTime:2021-01-24 06:24:31 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.6,},NodeAddress{Type:ExternalIP,Address:35.247.54.152,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-minion-group-jczt.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-minion-group-jczt.c.k8s-jkns-e2e-gke-ubuntu.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:78731c26804cca6e18934a1bb4eb5305,SystemUUID:78731c26-804c-ca6e-1893-4a1bb4eb5305,BootID:d2fd27ad-96ae-4ae9-b5df-886f63448173,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.281_7f033ea142efda],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:70314507,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:bec571992d40203edcd056ac0b0d97003887ee5e4be144c41932d18639673b03 k8s.gcr.io/sig-storage/csi-provisioner:v2.0.4],SizeBytes:20428748,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:e5ce22ddc2a6fbc9b5729dbcfaf1159c4b0d48dad62ddd1b93503c1348e4a406 k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.1],SizeBytes:19498883,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:ca160717df7f6b7964c936faf608b914f2277363e6d708ea2e2dbbf2c5f56a83 k8s.gcr.io/sig-storage/csi-resizer:v1.0.1],SizeBytes:19463877,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:7495d30800fb3ef22f3dc6d5fe9a0a6ec40ba32a2bdc0cf5e7fcaa507adc921e k8s.gcr.io/sig-storage/csi-attacher:v3.0.1],SizeBytes:19460260,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 24 07:16:22.241: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-minion-group-jczt Jan 24 07:16:22.279: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-minion-group-jczt Jan 24 07:16:22.337: INFO: kube-proxy-e2e-fd6004bb2a-9cdc3-minion-group-jczt started at 2021-01-24 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:22.337: INFO: Container kube-proxy ready: true, restart count 0 Jan 24 07:16:22.337: INFO: metadata-proxy-v0.1-9xllr started at 2021-01-24 06:24:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:16:22.337: INFO: Container metadata-proxy ready: true, restart count 0 Jan 24 07:16:22.337: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 24 07:16:22.337: INFO: coredns-6954c77b9b-w6tw6 started at 2021-01-24 06:24:32 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:22.337: INFO: Container coredns ready: true, restart count 0 Jan 24 07:16:22.337: INFO: kube-dns-autoscaler-76478fcf46-knm95 started at 2021-01-24 06:24:32 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:22.337: INFO: Container autoscaler ready: true, restart count 0 Jan 24 07:16:22.337: INFO: metrics-server-v0.3.6-8b98f98c9-zv9nj started at 2021-01-24 06:25:47 +0000 UTC (0+2 container statuses recorded) Jan 24 07:16:22.337: INFO: Container metrics-server ready: true, restart count 0 Jan 24 07:16:22.337: INFO: Container metrics-server-nanny ready: true, restart count 0 Jan 24 07:16:22.337: INFO: csi-gce-pd-controller-67cd645885-h2psn started at 2021-01-24 06:58:20 +0000 UTC (0+5 container statuses recorded) Jan 24 07:16:22.337: INFO: Container csi-attacher ready: true, restart count 0 Jan 24 07:16:22.337: INFO: Container csi-provisioner ready: true, restart count 0 Jan 24 07:16:22.337: INFO: Container csi-resizer ready: true, restart count 0 Jan 24 07:16:22.337: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 24 07:16:22.337: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:16:22.337: INFO: csi-gce-pd-node-rqsvb started at 2021-01-24 06:58:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:16:22.337: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:16:22.337: INFO: Container gce-pd-driver ready: true, restart count 0 W0124 07:16:22.382525 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:16:22.642: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-minion-group-jczt Jan 24 07:16:22.642: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-windows-node-group-00qx Jan 24 07:16:22.681: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-windows-node-group-00qx 5ed0daf7-7850-46a8-a847-4a9f888fe7e6 10347 0 2021-01-24 06:28:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-windows-node-group-00qx kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-windows-node-group-00qx"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-24 07:13:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-24 07:13:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-windows-node-group-00qx,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:28:13 +0000 UTC,LastTransitionTime:2021-01-24 06:28:13 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:15:35 +0000 UTC,LastTransitionTime:2021-01-24 06:28:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:15:35 +0000 UTC,LastTransitionTime:2021-01-24 06:28:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:15:35 +0000 UTC,LastTransitionTime:2021-01-24 06:28:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:15:35 +0000 UTC,LastTransitionTime:2021-01-24 06:28:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.233.40,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-00qx.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-00qx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-fd6004bb2a-9cdc3-windows-node-group-00qx,SystemUUID:B696F087-B1F3-E973-A95C-45B15D9F46F4,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-368566f2-94cf-40c4-933d-1afa02f58a0f],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-368566f2-94cf-40c4-933d-1afa02f58a0f,DevicePath:,},},Config:nil,},} Jan 24 07:16:22.681: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-windows-node-group-00qx Jan 24 07:16:22.720: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-windows-node-group-00qx Jan 24 07:16:22.771: INFO: csi-gce-pd-node-win-4zmh5 started at 2021-01-24 06:58:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:16:22.771: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:16:22.771: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:16:22.771: INFO: pod-subpath-test-dynamicpv-s8zd started at 2021-01-24 07:15:02 +0000 UTC (2+2 container statuses recorded) Jan 24 07:16:22.771: INFO: Init container init-volume-dynamicpv-s8zd ready: true, restart count 0 Jan 24 07:16:22.771: INFO: Init container test-init-subpath-dynamicpv-s8zd ready: true, restart count 0 Jan 24 07:16:22.771: INFO: Container test-container-subpath-dynamicpv-s8zd ready: false, restart count 0 Jan 24 07:16:22.771: INFO: Container test-container-volume-dynamicpv-s8zd ready: false, restart count 0 W0124 07:16:22.817700 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:16:23.683: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-windows-node-group-00qx Jan 24 07:16:23.683: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:16:23.720: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 611bbb19-0cca-4ca9-a790-28232fedc41e 10447 0 2021-01-24 06:27:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-windows-node-group-08j6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-24 07:03:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-24 07:06:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-windows-node-group-08j6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:27:59 +0000 UTC,LastTransitionTime:2021-01-24 06:27:59 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:15:58 +0000 UTC,LastTransitionTime:2021-01-24 06:27:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:15:58 +0000 UTC,LastTransitionTime:2021-01-24 06:27:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:15:58 +0000 UTC,LastTransitionTime:2021-01-24 06:27:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:15:58 +0000 UTC,LastTransitionTime:2021-01-24 06:28:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.83.246.182,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-08j6.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-08j6,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-fd6004bb2a-9cdc3-windows-node-group-08j6,SystemUUID:F89ED870-C6C5-2F35-433C-064895727A0B,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-5460d9e1-52e1-4348-b82f-a31e3d3c9fe7 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-da5bb9b9-8dde-4177-b0d3-3f49738e9fbb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-da5bb9b9-8dde-4177-b0d3-3f49738e9fbb,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-5460d9e1-52e1-4348-b82f-a31e3d3c9fe7,DevicePath:,},},Config:nil,},} Jan 24 07:16:23.720: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:16:23.758: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:16:23.800: INFO: csi-gce-pd-node-win-2j485 started at 2021-01-24 06:58:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:16:23.800: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:16:23.800: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:16:23.800: INFO: pod-subpath-test-dynamicpv-v7s9 started at 2021-01-24 07:15:00 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:23.800: INFO: Container test-container-subpath-dynamicpv-v7s9 ready: false, restart count 0 W0124 07:16:23.845104 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:16:24.138: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-windows-node-group-08j6 Jan 24 07:16:24.138: INFO: Logging node info for node e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h Jan 24 07:16:24.174: INFO: Node Info: &Node{ObjectMeta:{e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h a64dce98-2636-4d0e-8807-ce37fa7594d1 10502 0 2021-01-24 06:28:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/instances/e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-24 07:03:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-24 07:13:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gke-ubuntu/us-west1-b/e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-24 06:28:31 +0000 UTC,LastTransitionTime:2021-01-24 06:28:31 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-24 07:16:07 +0000 UTC,LastTransitionTime:2021-01-24 06:28:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-24 07:16:07 +0000 UTC,LastTransitionTime:2021-01-24 06:28:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-24 07:16:07 +0000 UTC,LastTransitionTime:2021-01-24 06:28:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-24 07:16:07 +0000 UTC,LastTransitionTime:2021-01-24 06:28:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.166.247,},NodeAddress{Type:InternalDNS,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h.c.k8s-jkns-e2e-gke-ubuntu.internal,},NodeAddress{Type:Hostname,Address:e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h,SystemUUID:A002E2FF-3952-75AC-4ED7-1635A3A547CF,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.281+7f033ea142efda,KubeProxyVersion:v1.21.0-alpha.1.281+7f033ea142efda,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver@sha256:e06877361e202cd89674559d2f620f2341ee4ecaf8870f5d55202570838dc216 gcr.io/k8s-jkns-e2e-gke-ubuntu/gcp-persistent-disk-csi-driver:3bf5f957-1a90-4caf-b653-428383efb992],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-1f33bf56-60c0-4a3f-a7a9-3f8d16f4e165 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-eaa1558f-0a48-49e4-bce1-b57613ce4d77],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-eaa1558f-0a48-49e4-bce1-b57613ce4d77,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gke-ubuntu/zones/us-west1-b/disks/pvc-1f33bf56-60c0-4a3f-a7a9-3f8d16f4e165,DevicePath:,},},Config:nil,},} Jan 24 07:16:24.175: INFO: Logging kubelet events for node e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h Jan 24 07:16:24.214: INFO: Logging pods the kubelet thinks is on node e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h Jan 24 07:16:24.253: INFO: csi-gce-pd-node-win-jcn62 started at 2021-01-24 06:58:21 +0000 UTC (0+2 container statuses recorded) Jan 24 07:16:24.253: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 24 07:16:24.253: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 24 07:16:24.253: INFO: external-client started at 2021-01-24 07:15:48 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:24.253: INFO: Container external-client ready: false, restart count 0 Jan 24 07:16:24.253: INFO: pvc-snapshottable-data-tester-cfptc started at 2021-01-24 07:16:23 +0000 UTC (0+1 container statuses recorded) Jan 24 07:16:24.253: INFO: Container volume-tester ready: false, restart count 0 W0124 07:16:24.299639 69180 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 24 07:16:24.769: INFO: Latency metrics for node e2e-fd6004bb2a-9cdc3-windows-node-group-qp6h Jan 24 07:16:24.769: INFO: Waiting up to 3m0s for all (but 3) nodes to be ready �[1mSTEP�[0m: Destroying namespace "snapshotting-2925" for this suite.
Filter through log files | View test history on testgrid
Check APIReachability
Deferred TearDown
DumpClusterLogs
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion
Extract
TearDown
TearDown Previous
Timeout
Up
diffResources
list nodes
listResources After
listResources Before
listResources Down
listResources Up
test setup
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail in binding dynamic provisioned PV to PVC [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (delayed binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (immediate binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][sig-windows] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][sig-windows] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable-stress[Feature:VolumeSnapshotDataSource] should support snapshotting of many volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable-stress[Feature:VolumeSnapshotDataSource] should support snapshotting of many volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (xfs)][Slow] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to create pod by failing to mount volume [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should store data