Recent runs || View in Spyglass
Result | FAILURE |
Tests | 3 failed / 42 succeeded |
Started | |
Elapsed | 1h25m |
Revision | master |
job-version | v1.21.0-alpha.1.277+676079605da916 |
revision | v1.21.0-alpha.1.277+676079605da916 |
error during /home/prow/go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver/test/run-windows-k8s-integration.sh: exit status 255
from junit_runner.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=External\sStorage\s\[Driver\:\scsi\-gcepd\-sc\-windows\]\s\[Testpattern\:\sDynamic\sSnapshot\s\(retain\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion$'
/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 Jan 23 23:23:09.801: Unexpected error: <*errors.errorString | 0xc003c70430>: { s: "Failed to find \"hello from snapshotting-8498 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-8498 namespace", last result: "���������������������������������������� " occurred /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268from junit_pdcsi.xml
[BeforeEach] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 23 23:15:02.364: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] volume snapshot controller /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:176 Jan 23 23:15:02.600: INFO: Creating resource for dynamic PV Jan 23 23:15:02.600: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-8498-e2e-scfpnxd �[1mSTEP�[0m: creating a claim Jan 23 23:15:02.644: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: starting a pod to use the claim Jan 23 23:15:02.776: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-qtp5c" in namespace "snapshotting-8498" to be "Succeeded or Failed" Jan 23 23:15:02.830: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 53.798211ms Jan 23 23:15:04.869: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2.092708448s Jan 23 23:15:06.926: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4.14986348s Jan 23 23:15:08.966: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6.190103338s Jan 23 23:15:11.006: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8.229794578s Jan 23 23:15:13.051: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10.27528889s Jan 23 23:15:15.090: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12.314508703s Jan 23 23:15:17.132: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14.355694683s Jan 23 23:15:19.177: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 16.401159875s Jan 23 23:15:21.223: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 18.44673109s Jan 23 23:15:23.266: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 20.489679222s Jan 23 23:15:25.305: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 22.529294846s Jan 23 23:15:27.645: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 24.869355569s Jan 23 23:15:29.685: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 26.909379593s Jan 23 23:15:31.780: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 29.004257585s Jan 23 23:15:33.819: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 31.043454421s Jan 23 23:15:35.862: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 33.085566718s Jan 23 23:15:37.903: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 35.12746308s Jan 23 23:15:39.943: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 37.166914199s Jan 23 23:15:41.992: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 39.21582217s Jan 23 23:15:44.031: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 41.254793436s Jan 23 23:15:46.070: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 43.294298986s Jan 23 23:15:48.109: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 45.33336024s Jan 23 23:15:50.150: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 47.373927135s Jan 23 23:15:52.189: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 49.41313396s Jan 23 23:15:54.283: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 51.506725915s Jan 23 23:15:56.322: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 53.545970886s Jan 23 23:15:58.363: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 55.587124973s Jan 23 23:16:00.406: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 57.630334751s Jan 23 23:16:02.449: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 59.672908541s Jan 23 23:16:04.489: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.712633762s Jan 23 23:16:06.528: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.752515194s Jan 23 23:16:08.568: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.792186563s Jan 23 23:16:10.619: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.843109277s Jan 23 23:16:12.658: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.882192247s Jan 23 23:16:14.703: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.927291329s Jan 23 23:16:16.747: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.970998195s Jan 23 23:16:18.791: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.015184164s Jan 23 23:16:20.836: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.060161262s Jan 23 23:16:22.876: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.099963873s Jan 23 23:16:24.927: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.151102109s Jan 23 23:16:26.974: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.197653955s Jan 23 23:16:29.013: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.236892129s Jan 23 23:16:31.068: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.292172247s Jan 23 23:16:33.108: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.332476563s Jan 23 23:16:35.148: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.371938219s Jan 23 23:16:37.216: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.439897792s Jan 23 23:16:39.255: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.479323072s Jan 23 23:16:41.295: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.518873832s Jan 23 23:16:43.334: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.557545049s Jan 23 23:16:45.375: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.598906142s Jan 23 23:16:47.414: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.638410202s Jan 23 23:16:49.463: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.686754668s Jan 23 23:16:51.511: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.734938683s Jan 23 23:16:53.551: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.775193895s Jan 23 23:16:55.596: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.819629858s Jan 23 23:16:57.706: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.930359816s Jan 23 23:16:59.749: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.973086484s Jan 23 23:17:01.793: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m59.017301567s Jan 23 23:17:03.835: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.05874133s Jan 23 23:17:05.875: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.099493552s Jan 23 23:17:07.923: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.147009839s Jan 23 23:17:09.966: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.190460165s Jan 23 23:17:12.007: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.231517312s Jan 23 23:17:14.046: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.270473556s Jan 23 23:17:16.086: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.309820123s Jan 23 23:17:18.129: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m15.352984675s Jan 23 23:17:20.173: INFO: Pod "pvc-snapshottable-tester-qtp5c": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2m17.396964107s �[1mSTEP�[0m: Saw pod success Jan 23 23:17:20.173: INFO: Pod "pvc-snapshottable-tester-qtp5c" satisfied condition "Succeeded or Failed" Jan 23 23:17:21.270: INFO: Pod pvc-snapshottable-tester-qtp5c has the following logs: Jan 23 23:17:21.270: INFO: Deleting pod "pvc-snapshottable-tester-qtp5c" in namespace "snapshotting-8498" Jan 23 23:17:21.323: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-qtp5c" to be fully deleted Jan 23 23:17:21.362: INFO: Waiting up to 5m0s for PersistentVolumeClaims [csi-gcepd-sc-windowsxgwv9] to have phase Bound Jan 23 23:17:21.401: INFO: PersistentVolumeClaim csi-gcepd-sc-windowsxgwv9 found and phase=Bound (39.044828ms) �[1mSTEP�[0m: checking the claim �[1mSTEP�[0m: checking the PV [BeforeEach] /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:190 �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jan 23 23:17:21.622: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-55bmd to become ready Jan 23 23:17:21.672: INFO: VolumeSnapshot snapshot-55bmd found but is not ready. Jan 23 23:17:23.712: INFO: VolumeSnapshot snapshot-55bmd found but is not ready. Jan 23 23:17:25.754: INFO: VolumeSnapshot snapshot-55bmd found but is not ready. Jan 23 23:17:27.794: INFO: VolumeSnapshot snapshot-55bmd found but is not ready. Jan 23 23:17:29.834: INFO: VolumeSnapshot snapshot-55bmd found but is not ready. Jan 23 23:17:31.880: INFO: VolumeSnapshot snapshot-55bmd found but is not ready. Jan 23 23:17:33.922: INFO: VolumeSnapshot snapshot-55bmd found but is not ready. Jan 23 23:17:35.962: INFO: VolumeSnapshot snapshot-55bmd found but is not ready. Jan 23 23:17:38.003: INFO: VolumeSnapshot snapshot-55bmd found but is not ready. Jan 23 23:17:40.042: INFO: VolumeSnapshot snapshot-55bmd found but is not ready. Jan 23 23:17:42.082: INFO: VolumeSnapshot snapshot-55bmd found and is ready Jan 23 23:17:42.082: INFO: WaitUntil finished successfully after 20.460721549s Jan 23 23:17:42.129: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-7a23cc1e-ee17-4397-a353-884ae27a4e03 creationTime:2021-01-23T23:17:23Z readyToUse:true restoreSize:5Gi] Jan 23 23:17:42.129: INFO: snapshotContentName snapcontent-7a23cc1e-ee17-4397-a353-884ae27a4e03 [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: Modifying source data test �[1mSTEP�[0m: modifying the data in the source PVC Jan 23 23:17:42.294: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-46js5" in namespace "snapshotting-8498" to be "Succeeded or Failed" Jan 23 23:17:42.333: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 38.808177ms Jan 23 23:17:44.377: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.082653414s Jan 23 23:17:46.416: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.122499291s Jan 23 23:17:48.458: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.163693975s Jan 23 23:17:50.498: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.204137423s Jan 23 23:17:52.538: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.243698971s Jan 23 23:17:54.578: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 12.284145737s Jan 23 23:17:56.619: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 14.32517863s Jan 23 23:17:58.659: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.364831873s Jan 23 23:18:00.699: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 18.404883052s Jan 23 23:18:02.738: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 20.444278719s Jan 23 23:18:04.780: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 22.485694993s Jan 23 23:18:06.821: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 24.52750164s Jan 23 23:18:08.861: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 26.567432433s Jan 23 23:18:10.985: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 28.690867698s Jan 23 23:18:13.024: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.730492026s Jan 23 23:18:15.064: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 32.769817938s Jan 23 23:18:17.103: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 34.808723388s Jan 23 23:18:19.173: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 36.878986484s Jan 23 23:18:21.247: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 38.953512423s Jan 23 23:18:23.289: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 40.995014092s Jan 23 23:18:25.329: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 43.035012887s Jan 23 23:18:27.369: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 45.075109584s Jan 23 23:18:29.409: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 47.114799304s Jan 23 23:18:31.448: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 49.154107815s Jan 23 23:18:33.489: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 51.195037512s Jan 23 23:18:35.528: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 53.233915603s Jan 23 23:18:37.567: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 55.273161517s Jan 23 23:18:39.606: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 57.312414088s Jan 23 23:18:41.646: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 59.352413677s Jan 23 23:18:43.686: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.392383995s Jan 23 23:18:45.726: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.431856008s Jan 23 23:18:47.765: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.471274892s Jan 23 23:18:49.804: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.51026582s Jan 23 23:18:51.846: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.55212267s Jan 23 23:18:53.885: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.591594965s Jan 23 23:18:55.926: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.632024378s Jan 23 23:18:57.965: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.671407074s Jan 23 23:19:00.004: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.710622562s Jan 23 23:19:02.044: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.749790698s Jan 23 23:19:04.083: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.78907681s Jan 23 23:19:06.122: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.828285919s Jan 23 23:19:08.164: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.870229832s Jan 23 23:19:10.203: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.909135928s Jan 23 23:19:12.242: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.9484336s Jan 23 23:19:14.284: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.9899879s Jan 23 23:19:16.323: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.029203408s Jan 23 23:19:18.362: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.067977765s Jan 23 23:19:20.402: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.10823626s Jan 23 23:19:22.445: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.151082651s Jan 23 23:19:24.485: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.190804688s Jan 23 23:19:26.524: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.229948103s Jan 23 23:19:28.563: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.269095742s Jan 23 23:19:30.603: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.309032217s Jan 23 23:19:32.642: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.34783605s Jan 23 23:19:34.684: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.390593136s Jan 23 23:19:36.725: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.431427883s Jan 23 23:19:38.764: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.470343198s Jan 23 23:19:40.803: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.509468905s Jan 23 23:19:42.842: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.548300375s Jan 23 23:19:44.881: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.586987671s Jan 23 23:19:46.922: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.627902747s Jan 23 23:19:48.962: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.668470248s Jan 23 23:19:51.002: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.707814848s Jan 23 23:19:53.040: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.746481509s Jan 23 23:19:55.079: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.785168184s Jan 23 23:19:57.119: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.825252006s Jan 23 23:19:59.160: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.866097589s Jan 23 23:20:01.200: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.905836708s Jan 23 23:20:03.238: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.944473206s Jan 23 23:20:05.292: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.998291s Jan 23 23:20:07.332: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m25.038001565s Jan 23 23:20:09.387: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m27.092794851s Jan 23 23:20:11.427: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m29.133366403s Jan 23 23:20:13.466: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m31.172255808s Jan 23 23:20:15.508: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m33.213937006s Jan 23 23:20:17.547: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m35.253052587s Jan 23 23:20:19.585: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m37.29151072s Jan 23 23:20:21.627: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m39.332976733s Jan 23 23:20:23.672: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m41.377888261s Jan 23 23:20:25.711: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m43.416746794s Jan 23 23:20:27.750: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m45.456112478s Jan 23 23:20:29.789: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m47.495580759s Jan 23 23:20:31.829: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m49.535041334s Jan 23 23:20:33.868: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m51.574156321s Jan 23 23:20:35.955: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m53.660783983s Jan 23 23:20:37.995: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.701486434s Jan 23 23:20:40.034: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.740126661s Jan 23 23:20:42.073: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.779013842s Jan 23 23:20:44.113: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.81881607s Jan 23 23:20:46.198: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.904242106s Jan 23 23:20:48.238: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.94433265s Jan 23 23:20:50.277: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.98361332s Jan 23 23:20:52.317: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.023343885s Jan 23 23:20:54.356: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.062163749s Jan 23 23:20:56.395: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.101232051s Jan 23 23:20:58.434: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.140008989s Jan 23 23:21:00.473: INFO: Pod "pvc-snapshottable-data-tester-46js5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 3m18.179060947s �[1mSTEP�[0m: Saw pod success Jan 23 23:21:00.473: INFO: Pod "pvc-snapshottable-data-tester-46js5" satisfied condition "Succeeded or Failed" Jan 23 23:21:01.334: INFO: Pod pvc-snapshottable-data-tester-46js5 has the following logs: Jan 23 23:21:01.334: INFO: Deleting pod "pvc-snapshottable-data-tester-46js5" in namespace "snapshotting-8498" Jan 23 23:21:01.385: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-46js5" to be fully deleted �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the claim Jan 23 23:22:09.598: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:12.023: INFO: stderr: "" Jan 23 23:22:12.023: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:14.024: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:15.170: INFO: stderr: "" Jan 23 23:22:15.170: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:17.170: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:18.311: INFO: stderr: "" Jan 23 23:22:18.311: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:20.311: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:21.480: INFO: stderr: "" Jan 23 23:22:21.480: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:23.480: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:24.953: INFO: stderr: "" Jan 23 23:22:24.953: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:26.953: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:28.328: INFO: stderr: "" Jan 23 23:22:28.328: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:30.329: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:31.714: INFO: stderr: "" Jan 23 23:22:31.714: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:33.714: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:34.854: INFO: stderr: "" Jan 23 23:22:34.855: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:36.855: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:38.381: INFO: stderr: "" Jan 23 23:22:38.381: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:40.381: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:41.797: INFO: stderr: "" Jan 23 23:22:41.797: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:43.798: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:44.879: INFO: stderr: "" Jan 23 23:22:44.879: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:46.879: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:48.008: INFO: stderr: "" Jan 23 23:22:48.008: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:50.008: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:51.133: INFO: stderr: "" Jan 23 23:22:51.133: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:53.133: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:54.831: INFO: stderr: "" Jan 23 23:22:54.831: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:56.831: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:22:57.950: INFO: stderr: "" Jan 23 23:22:57.950: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:22:59.951: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:23:01.058: INFO: stderr: "" Jan 23 23:23:01.058: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:23:03.059: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:23:04.233: INFO: stderr: "" Jan 23 23:23:04.233: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:23:06.233: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8498 exec restored-pvc-tester-5vd52 --namespace=snapshotting-8498 -- powershell /c type /mnt/test/data' Jan 23 23:23:07.800: INFO: stderr: "" Jan 23 23:23:07.800: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:23:09.800: FAIL: Unexpected error: <*errors.errorString | 0xc003c70430>: { s: "Failed to find \"hello from snapshotting-8498 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-8498 namespace", last result: "���������������������������������������� " occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.5.2() /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268 +0x1254 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003e76480) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc003e76480) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc003e76480, 0x4ff25b0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] volume snapshot controller /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:179 Jan 23 23:23:09.876: INFO: Pod restored-pvc-tester-5vd52 has the following logs: Jan 23 23:23:09.876: INFO: Deleting pod "restored-pvc-tester-5vd52" in namespace "snapshotting-8498" Jan 23 23:23:09.926: INFO: Wait up to 5m0s for pod "restored-pvc-tester-5vd52" to be fully deleted Jan 23 23:23:14.003: INFO: deleting claim "snapshotting-8498"/"pvc-4l2kk" Jan 23 23:23:14.043: INFO: deleting snapshot "snapshotting-8498"/"snapshot-55bmd" Jan 23 23:23:14.082: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-7a23cc1e-ee17-4397-a353-884ae27a4e03 creationTime:2021-01-23T23:17:23Z readyToUse:true restoreSize:5Gi] Jan 23 23:23:14.082: INFO: snapshotContentName snapcontent-7a23cc1e-ee17-4397-a353-884ae27a4e03 Jan 23 23:23:14.210: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-7a23cc1e-ee17-4397-a353-884ae27a4e03 to be deleted Jan 23 23:23:14.291: INFO: volumesnapshotcontents snapcontent-7a23cc1e-ee17-4397-a353-884ae27a4e03 has been found and is not deleted Jan 23 23:23:16.330: INFO: volumesnapshotcontents snapcontent-7a23cc1e-ee17-4397-a353-884ae27a4e03 has been found and is not deleted Jan 23 23:23:18.376: INFO: volumesnapshotcontents snapcontent-7a23cc1e-ee17-4397-a353-884ae27a4e03 has been found and is not deleted Jan 23 23:23:20.420: INFO: volumesnapshotcontents snapcontent-7a23cc1e-ee17-4397-a353-884ae27a4e03 has been found and is not deleted Jan 23 23:23:22.458: INFO: volumesnapshotcontents snapcontent-7a23cc1e-ee17-4397-a353-884ae27a4e03 is not found and has been deleted Jan 23 23:23:22.458: INFO: WaitUntil finished successfully after 8.248250473s Jan 23 23:23:22.458: INFO: deleting snapshot content "snapcontent-7a23cc1e-ee17-4397-a353-884ae27a4e03" Jan 23 23:23:22.495: INFO: deleting snapshot class "snapshotting-8498-vsc25kcw" Jan 23 23:23:22.539: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-8498-vsc25kcw to be deleted Jan 23 23:23:22.577: INFO: volumesnapshotclasses snapshotting-8498-vsc25kcw is not found and has been deleted Jan 23 23:23:22.577: INFO: WaitUntil finished successfully after 38.09631ms �[1mSTEP�[0m: Deleting pvc Jan 23 23:23:22.654: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windowsxgwv9" Jan 23 23:23:22.697: INFO: Waiting up to 5m0s for PersistentVolume pvc-6696b36d-5282-4f63-8e6d-d602afc0a0a2 to get deleted Jan 23 23:23:22.735: INFO: PersistentVolume pvc-6696b36d-5282-4f63-8e6d-d602afc0a0a2 found and phase=Released (38.061356ms) Jan 23 23:23:27.774: INFO: PersistentVolume pvc-6696b36d-5282-4f63-8e6d-d602afc0a0a2 was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-8498". �[1mSTEP�[0m: Found 31 events. Jan 23 23:23:27.855: INFO: At 2021-01-23 23:15:02 +0000 UTC - event for csi-gcepd-sc-windowsxgwv9: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 23 23:23:27.855: INFO: At 2021-01-23 23:15:02 +0000 UTC - event for csi-gcepd-sc-windowsxgwv9: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 23 23:23:27.855: INFO: At 2021-01-23 23:15:02 +0000 UTC - event for csi-gcepd-sc-windowsxgwv9: {pd.csi.storage.gke.io_e2e-38e8f98620-9cdc3-minion-group-kk4b_9fa2d7f6-b31b-45c3-897d-bf1f8a71bcb0 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-8498/csi-gcepd-sc-windowsxgwv9" Jan 23 23:23:27.855: INFO: At 2021-01-23 23:15:06 +0000 UTC - event for csi-gcepd-sc-windowsxgwv9: {pd.csi.storage.gke.io_e2e-38e8f98620-9cdc3-minion-group-kk4b_9fa2d7f6-b31b-45c3-897d-bf1f8a71bcb0 } ProvisioningSucceeded: Successfully provisioned volume pvc-6696b36d-5282-4f63-8e6d-d602afc0a0a2 Jan 23 23:23:27.855: INFO: At 2021-01-23 23:15:06 +0000 UTC - event for pvc-snapshottable-tester-qtp5c: {default-scheduler } Scheduled: Successfully assigned snapshotting-8498/pvc-snapshottable-tester-qtp5c to e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:23:27.855: INFO: At 2021-01-23 23:15:20 +0000 UTC - event for pvc-snapshottable-tester-qtp5c: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-6696b36d-5282-4f63-8e6d-d602afc0a0a2" Jan 23 23:23:27.855: INFO: At 2021-01-23 23:16:47 +0000 UTC - event for pvc-snapshottable-tester-qtp5c: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "db836ce86a35c8c5e0f8a466aed4e2f2e155aeb87a8fe5eacc33cd06fbd7c75c" network for pod "pvc-snapshottable-tester-qtp5c": networkPlugin cni failed to set up pod "pvc-snapshottable-tester-qtp5c_snapshotting-8498" network: error while executing ADD command: error while ProvisionEndpoint(db836ce86a35c8c5e0f8a466aed4e2f2e155aeb87a8fe5eacc33cd06fbd7c75c_l2bridge,6ECC1478-0795-4C9F-BAF7-EF5B50326E4C,db836ce86a35c8c5e0f8a466aed4e2f2e155aeb87a8fe5eacc33cd06fbd7c75c): Element not found. Jan 23 23:23:27.855: INFO: At 2021-01-23 23:16:49 +0000 UTC - event for pvc-snapshottable-tester-qtp5c: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 23 23:23:27.855: INFO: At 2021-01-23 23:17:03 +0000 UTC - event for pvc-snapshottable-tester-qtp5c: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Created: Created container volume-tester Jan 23 23:23:27.855: INFO: At 2021-01-23 23:17:03 +0000 UTC - event for pvc-snapshottable-tester-qtp5c: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 23 23:23:27.855: INFO: At 2021-01-23 23:17:06 +0000 UTC - event for pvc-snapshottable-tester-qtp5c: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Started: Started container volume-tester Jan 23 23:23:27.855: INFO: At 2021-01-23 23:17:21 +0000 UTC - event for snapshot-55bmd: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-8498/snapshot-55bmd to be created by the CSI driver. Jan 23 23:23:27.855: INFO: At 2021-01-23 23:17:42 +0000 UTC - event for pvc-snapshottable-data-tester-46js5: {default-scheduler } Scheduled: Successfully assigned snapshotting-8498/pvc-snapshottable-data-tester-46js5 to e2e-38e8f98620-9cdc3-windows-node-group-g5jr Jan 23 23:23:27.855: INFO: At 2021-01-23 23:17:42 +0000 UTC - event for pvc-snapshottable-data-tester-46js5: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-6696b36d-5282-4f63-8e6d-d602afc0a0a2" Volume is already exclusively attached to one node and can't be attached to another Jan 23 23:23:27.855: INFO: At 2021-01-23 23:18:10 +0000 UTC - event for pvc-snapshottable-data-tester-46js5: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-6696b36d-5282-4f63-8e6d-d602afc0a0a2" Jan 23 23:23:27.855: INFO: At 2021-01-23 23:19:45 +0000 UTC - event for pvc-snapshottable-data-tester-46js5: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-g5jr} FailedMount: Unable to attach or mount volumes: unmounted volumes=[my-volume], unattached volumes=[my-volume default-token-2j5w9]: timed out waiting for the condition Jan 23 23:23:27.855: INFO: At 2021-01-23 23:20:16 +0000 UTC - event for pvc-snapshottable-data-tester-46js5: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-g5jr} FailedMount: MountVolume.MountDevice failed for volume "pvc-6696b36d-5282-4f63-8e6d-d602afc0a0a2" : rpc error: code = DeadlineExceeded desc = context deadline exceeded Jan 23 23:23:27.855: INFO: At 2021-01-23 23:20:17 +0000 UTC - event for pvc-snapshottable-data-tester-46js5: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-g5jr} FailedMount: MountVolume.MountDevice failed for volume "pvc-6696b36d-5282-4f63-8e6d-d602afc0a0a2" : rpc error: code = Aborted desc = An operation with the given Volume ID projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-6696b36d-5282-4f63-8e6d-d602afc0a0a2 already exists Jan 23 23:23:27.855: INFO: At 2021-01-23 23:20:45 +0000 UTC - event for pvc-snapshottable-data-tester-46js5: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-g5jr} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 23 23:23:27.855: INFO: At 2021-01-23 23:20:45 +0000 UTC - event for pvc-snapshottable-data-tester-46js5: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-g5jr} Created: Created container volume-tester Jan 23 23:23:27.855: INFO: At 2021-01-23 23:20:48 +0000 UTC - event for pvc-snapshottable-data-tester-46js5: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-g5jr} Started: Started container volume-tester Jan 23 23:23:27.855: INFO: At 2021-01-23 23:21:01 +0000 UTC - event for pvc-4l2kk: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 23 23:23:27.855: INFO: At 2021-01-23 23:21:01 +0000 UTC - event for pvc-4l2kk: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 23 23:23:27.855: INFO: At 2021-01-23 23:21:01 +0000 UTC - event for pvc-4l2kk: {pd.csi.storage.gke.io_e2e-38e8f98620-9cdc3-minion-group-kk4b_9fa2d7f6-b31b-45c3-897d-bf1f8a71bcb0 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-8498/pvc-4l2kk" Jan 23 23:23:27.855: INFO: At 2021-01-23 23:21:23 +0000 UTC - event for pvc-4l2kk: {pd.csi.storage.gke.io_e2e-38e8f98620-9cdc3-minion-group-kk4b_9fa2d7f6-b31b-45c3-897d-bf1f8a71bcb0 } ProvisioningSucceeded: Successfully provisioned volume pvc-23dba535-e75e-4028-839f-4a64f223a2c6 Jan 23 23:23:27.855: INFO: At 2021-01-23 23:21:24 +0000 UTC - event for restored-pvc-tester-5vd52: {default-scheduler } Scheduled: Successfully assigned snapshotting-8498/restored-pvc-tester-5vd52 to e2e-38e8f98620-9cdc3-windows-node-group-x4wl Jan 23 23:23:27.855: INFO: At 2021-01-23 23:21:36 +0000 UTC - event for restored-pvc-tester-5vd52: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-23dba535-e75e-4028-839f-4a64f223a2c6" Jan 23 23:23:27.855: INFO: At 2021-01-23 23:22:03 +0000 UTC - event for restored-pvc-tester-5vd52: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-x4wl} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 23 23:23:27.855: INFO: At 2021-01-23 23:22:03 +0000 UTC - event for restored-pvc-tester-5vd52: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-x4wl} Created: Created container volume-tester Jan 23 23:23:27.855: INFO: At 2021-01-23 23:22:04 +0000 UTC - event for restored-pvc-tester-5vd52: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-x4wl} Started: Started container volume-tester Jan 23 23:23:27.855: INFO: At 2021-01-23 23:23:09 +0000 UTC - event for restored-pvc-tester-5vd52: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-x4wl} Killing: Stopping container volume-tester Jan 23 23:23:27.893: INFO: POD NODE PHASE GRACE CONDITIONS Jan 23 23:23:27.893: INFO: Jan 23 23:23:27.935: INFO: Logging node info for node e2e-38e8f98620-9cdc3-master Jan 23 23:23:27.975: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-master 3e77ba53-43f9-4513-aa17-db3cc1d4b206 11795 0 2021-01-23 22:19:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-23 22:19:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2021-01-23 23:00:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-23 23:04:06 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3866853376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3604709376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:19:17 +0000 UTC,LastTransitionTime:2021-01-23 22:19:17 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.227.153.143,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-master.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-master.c.k8s-jkns-gci-gce-alpha-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:edeb9f32b2630f47cc3b499c986b246f,SystemUUID:edeb9f32-b263-0f47-cc3b-499c986b246f,BootID:11afb933-8d2f-432c-ab86-319918cea8e9,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.21.0-alpha.1.277_676079605da916],SizeBytes:123005230,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.21.0-alpha.1.277_676079605da916],SizeBytes:117528906,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:70314536,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.21.0-alpha.1.277_676079605da916],SizeBytes:47716661,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 23 23:23:27.975: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-master Jan 23 23:23:28.013: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-master Jan 23 23:23:28.059: INFO: etcd-server-events-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:17:59 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.059: INFO: Container etcd-container ready: true, restart count 0 Jan 23 23:23:28.059: INFO: etcd-server-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:18:09 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.059: INFO: Container etcd-container ready: true, restart count 0 Jan 23 23:23:28.059: INFO: kube-apiserver-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:18:19 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.059: INFO: Container kube-apiserver ready: true, restart count 0 Jan 23 23:23:28.059: INFO: kube-controller-manager-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:18:29 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.059: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 23 23:23:28.059: INFO: metadata-proxy-v0.1-jsfs4 started at 2021-01-23 22:19:46 +0000 UTC (0+2 container statuses recorded) Jan 23 23:23:28.059: INFO: Container metadata-proxy ready: true, restart count 0 Jan 23 23:23:28.059: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 23 23:23:28.059: INFO: csi-gce-pd-node-jqcl5 started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:23:28.059: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:23:28.059: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 23 23:23:28.059: INFO: kube-scheduler-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:17:49 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.059: INFO: Container kube-scheduler ready: true, restart count 0 Jan 23 23:23:28.059: INFO: kube-addon-manager-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:18:55 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.059: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 23 23:23:28.059: INFO: l7-lb-controller-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:19:05 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.059: INFO: Container l7-lb-controller ready: true, restart count 0 W0123 23:23:28.105369 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:23:28.379: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-master Jan 23 23:23:28.379: INFO: Logging node info for node e2e-38e8f98620-9cdc3-minion-group-glhc Jan 23 23:23:28.418: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-minion-group-glhc 29738114-e007-415f-a860-8bc897de518e 11796 0 2021-01-23 22:19:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-minion-group-glhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-minion-group-glhc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-23 22:19:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-23 22:19:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-23 23:00:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-23 23:04:06 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-minion-group-glhc,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-23 23:19:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-23 23:19:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-23 23:19:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-23 23:19:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-23 23:19:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-23 23:19:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-23 23:19:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:19:27 +0000 UTC,LastTransitionTime:2021-01-23 22:19:27 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.6,},NodeAddress{Type:ExternalIP,Address:35.227.190.27,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-minion-group-glhc.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-minion-group-glhc.c.k8s-jkns-gci-gce-alpha-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d51eb9e71d15d2f95c4f6a26324f7265,SystemUUID:d51eb9e7-1d15-d2f9-5c4f-6a26324f7265,BootID:8d416c16-deb3-486e-b86c-30df795e0989,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.277_676079605da916],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:70314536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:a494ff6ec10e05a454458fbf44247d93c9b3a0d983a00b538e442f353b7030c8 k8s.gcr.io/sig-storage/snapshot-controller:v3.0.2],SizeBytes:17461280,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 23 23:23:28.418: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-minion-group-glhc Jan 23 23:23:28.458: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-minion-group-glhc Jan 23 23:23:28.523: INFO: kube-proxy-e2e-38e8f98620-9cdc3-minion-group-glhc started at 2021-01-23 22:19:27 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.523: INFO: Container kube-proxy ready: true, restart count 0 Jan 23 23:23:28.523: INFO: metadata-proxy-v0.1-xr8n2 started at 2021-01-23 22:19:27 +0000 UTC (0+2 container statuses recorded) Jan 23 23:23:28.523: INFO: Container metadata-proxy ready: true, restart count 0 Jan 23 23:23:28.523: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 23 23:23:28.523: INFO: csi-gce-pd-node-kljkr started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:23:28.523: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:23:28.523: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 23 23:23:28.523: INFO: volume-snapshot-controller-0 started at 2021-01-23 22:19:41 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.523: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jan 23 23:23:28.523: INFO: kube-dns-autoscaler-76478fcf46-xrbjs started at 2021-01-23 22:19:41 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.523: INFO: Container autoscaler ready: true, restart count 0 Jan 23 23:23:28.523: INFO: coredns-6954c77b9b-4t4sq started at 2021-01-23 22:19:50 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.523: INFO: Container coredns ready: true, restart count 0 W0123 23:23:28.579946 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:23:28.796: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-minion-group-glhc Jan 23 23:23:28.796: INFO: Logging node info for node e2e-38e8f98620-9cdc3-minion-group-kk4b Jan 23 23:23:28.836: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-minion-group-kk4b 5ecd4da2-2160-4e5d-9e06-71d27ed35509 11794 0 2021-01-23 22:19:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-minion-group-kk4b kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-minion-group-kk4b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-23 22:19:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.5.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-23 22:19:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-23 23:00:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-23 23:04:06 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.5.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-minion-group-kk4b,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.5.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823962112 0} {<nil>} 7640588Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561818112 0} {<nil>} 7384588Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-23 23:19:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-23 23:19:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-23 23:19:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-23 23:19:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-23 23:19:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-23 23:19:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-23 23:19:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:19:25 +0000 UTC,LastTransitionTime:2021-01-23 22:19:25 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:20:32 +0000 UTC,LastTransitionTime:2021-01-23 22:19:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.7,},NodeAddress{Type:ExternalIP,Address:35.230.85.214,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-minion-group-kk4b.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-minion-group-kk4b.c.k8s-jkns-gci-gce-alpha-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0f2d04d5b7e9c396aacef591ee8a232d,SystemUUID:0f2d04d5-b7e9-c396-aace-f591ee8a232d,BootID:e958037b-0884-4ed8-9d3d-7f0345b4eaa5,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.277_676079605da916],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:70314536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:bec571992d40203edcd056ac0b0d97003887ee5e4be144c41932d18639673b03 k8s.gcr.io/sig-storage/csi-provisioner:v2.0.4],SizeBytes:20428748,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:e5ce22ddc2a6fbc9b5729dbcfaf1159c4b0d48dad62ddd1b93503c1348e4a406 k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.1],SizeBytes:19498883,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:ca160717df7f6b7964c936faf608b914f2277363e6d708ea2e2dbbf2c5f56a83 k8s.gcr.io/sig-storage/csi-resizer:v1.0.1],SizeBytes:19463877,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:7495d30800fb3ef22f3dc6d5fe9a0a6ec40ba32a2bdc0cf5e7fcaa507adc921e k8s.gcr.io/sig-storage/csi-attacher:v3.0.1],SizeBytes:19460260,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 23 23:23:28.837: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-minion-group-kk4b Jan 23 23:23:28.876: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-minion-group-kk4b Jan 23 23:23:28.945: INFO: metrics-server-v0.3.6-8b98f98c9-kzbnd started at 2021-01-23 22:20:12 +0000 UTC (0+2 container statuses recorded) Jan 23 23:23:28.945: INFO: Container metrics-server ready: true, restart count 0 Jan 23 23:23:28.945: INFO: Container metrics-server-nanny ready: true, restart count 0 Jan 23 23:23:28.945: INFO: csi-gce-pd-node-5769z started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:23:28.945: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:23:28.945: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 23 23:23:28.945: INFO: kube-proxy-e2e-38e8f98620-9cdc3-minion-group-kk4b started at 2021-01-23 22:19:25 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.945: INFO: Container kube-proxy ready: true, restart count 0 Jan 23 23:23:28.945: INFO: metadata-proxy-v0.1-bj49g started at 2021-01-23 22:19:25 +0000 UTC (0+2 container statuses recorded) Jan 23 23:23:28.945: INFO: Container metadata-proxy ready: true, restart count 0 Jan 23 23:23:28.945: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 23 23:23:28.945: INFO: l7-default-backend-6dd8477499-trvcq started at 2021-01-23 22:19:41 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.945: INFO: Container default-http-backend ready: true, restart count 0 Jan 23 23:23:28.945: INFO: coredns-6954c77b9b-tm78c started at 2021-01-23 22:19:41 +0000 UTC (0+1 container statuses recorded) Jan 23 23:23:28.945: INFO: Container coredns ready: true, restart count 0 Jan 23 23:23:28.945: INFO: csi-gce-pd-controller-7bccfb5d44-7gdrx started at 2021-01-23 22:59:51 +0000 UTC (0+5 container statuses recorded) Jan 23 23:23:28.945: INFO: Container csi-attacher ready: true, restart count 0 Jan 23 23:23:28.945: INFO: Container csi-provisioner ready: true, restart count 0 Jan 23 23:23:28.945: INFO: Container csi-resizer ready: true, restart count 0 Jan 23 23:23:28.945: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 23 23:23:28.945: INFO: Container gce-pd-driver ready: true, restart count 0 W0123 23:23:28.991123 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:23:29.233: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-minion-group-kk4b Jan 23 23:23:29.233: INFO: Logging node info for node e2e-38e8f98620-9cdc3-windows-node-group-g5jr Jan 23 23:23:29.273: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-windows-node-group-g5jr 96c9c63f-b8e9-4d89-9b54-624584d57e49 12378 0 2021-01-23 22:24:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-windows-node-group-g5jr kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-windows-node-group-g5jr"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-23 23:04:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet.exe Update v1 2021-01-23 23:22:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-windows-node-group-g5jr,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:24:47 +0000 UTC,LastTransitionTime:2021-01-23 22:24:47 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:22:58 +0000 UTC,LastTransitionTime:2021-01-23 22:24:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:22:58 +0000 UTC,LastTransitionTime:2021-01-23 22:24:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:22:58 +0000 UTC,LastTransitionTime:2021-01-23 22:24:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:22:58 +0000 UTC,LastTransitionTime:2021-01-23 22:24:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.230.101.42,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-windows-node-group-g5jr.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-windows-node-group-g5jr,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-38e8f98620-9cdc3-windows-node-group-g5jr,SystemUUID:FB18DA59-CD6F-B2CA-9CE5-893B249DE0C3,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 23 23:23:29.273: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-windows-node-group-g5jr Jan 23 23:23:29.311: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-windows-node-group-g5jr Jan 23 23:23:29.353: INFO: csi-gce-pd-node-win-c2hlr started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:23:29.353: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:23:29.353: INFO: Container gce-pd-driver ready: true, restart count 0 W0123 23:23:29.398845 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:23:29.644: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-windows-node-group-g5jr Jan 23 23:23:29.645: INFO: Logging node info for node e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:23:29.684: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-windows-node-group-nxd1 2bdfbd92-17b9-4c27-a60f-b631dd55d251 12358 0 2021-01-23 22:24:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-windows-node-group-nxd1 kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-windows-node-group-nxd1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-23 23:12:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet.exe Update v1 2021-01-23 23:22:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-windows-node-group-nxd1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:24:43 +0000 UTC,LastTransitionTime:2021-01-23 22:24:43 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:22:52 +0000 UTC,LastTransitionTime:2021-01-23 22:24:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:22:52 +0000 UTC,LastTransitionTime:2021-01-23 22:24:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:22:52 +0000 UTC,LastTransitionTime:2021-01-23 22:24:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:22:52 +0000 UTC,LastTransitionTime:2021-01-23 22:24:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.235.105,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-windows-node-group-nxd1.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-windows-node-group-nxd1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-38e8f98620-9cdc3-windows-node-group-nxd1,SystemUUID:86179274-1E9D-D2E8-DA3D-7A0AC6C47BF4,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 23 23:23:29.685: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:23:29.722: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:23:29.787: INFO: csi-gce-pd-node-win-dm6qt started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:23:29.787: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:23:29.787: INFO: Container gce-pd-driver ready: true, restart count 0 W0123 23:23:29.833376 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:23:30.151: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:23:30.151: INFO: Logging node info for node e2e-38e8f98620-9cdc3-windows-node-group-x4wl Jan 23 23:23:30.191: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-windows-node-group-x4wl ae8b10e0-a000-4159-b12d-49a91e2dfbf3 12524 0 2021-01-23 22:24:24 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-windows-node-group-x4wl kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-windows-node-group-x4wl"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-23 23:21:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet.exe Update v1 2021-01-23 23:23:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-windows-node-group-x4wl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:24:25 +0000 UTC,LastTransitionTime:2021-01-23 22:24:25 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:23:28 +0000 UTC,LastTransitionTime:2021-01-23 22:24:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:23:28 +0000 UTC,LastTransitionTime:2021-01-23 22:24:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:23:28 +0000 UTC,LastTransitionTime:2021-01-23 22:24:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:23:28 +0000 UTC,LastTransitionTime:2021-01-23 22:24:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:35.247.50.93,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-windows-node-group-x4wl.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-windows-node-group-x4wl,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-38e8f98620-9cdc3-windows-node-group-x4wl,SystemUUID:959C1E36-9643-3B4F-8640-F4E058BACB3D,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 23 23:23:30.191: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-windows-node-group-x4wl Jan 23 23:23:30.231: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-windows-node-group-x4wl Jan 23 23:23:30.273: INFO: csi-gce-pd-node-win-tdrvh started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:23:30.273: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:23:30.273: INFO: Container gce-pd-driver ready: true, restart count 0 W0123 23:23:30.321536 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:23:30.551: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-windows-node-group-x4wl Jan 23 23:23:30.551: INFO: Waiting up to 3m0s for all (but 3) nodes to be ready �[1mSTEP�[0m: Destroying namespace "snapshotting-8498" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=External\sStorage\s\[Driver\:\scsi\-gcepd\-sc\-windows\]\s\[Testpattern\:\sPre\-provisioned\sSnapshot\s\(delete\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion$'
/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 Jan 23 23:14:10.624: Unexpected error: <*errors.errorString | 0xc00394c870>: { s: "Failed to find \"hello from snapshotting-1686 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-1686 namespace", last result: "���������������������������������������� " occurred /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268from junit_pdcsi.xml
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 23 23:09:14.847: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] volume snapshot controller /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:176 Jan 23 23:09:15.048: INFO: Creating resource for dynamic PV Jan 23 23:09:15.048: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-1686-e2e-sc9lclg �[1mSTEP�[0m: creating a claim Jan 23 23:09:15.088: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: starting a pod to use the claim Jan 23 23:09:15.208: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-st5wz" in namespace "snapshotting-1686" to be "Succeeded or Failed" Jan 23 23:09:15.247: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 38.42549ms Jan 23 23:09:17.286: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 2.077370849s Jan 23 23:09:19.324: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 4.115865991s Jan 23 23:09:21.367: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 6.158309243s Jan 23 23:09:23.409: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 8.200456294s Jan 23 23:09:25.449: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 10.240485061s Jan 23 23:09:27.488: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 12.279242779s Jan 23 23:09:29.526: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 14.317808024s Jan 23 23:09:31.565: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 16.356389043s Jan 23 23:09:33.604: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 18.395269551s Jan 23 23:09:35.643: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 20.434265724s Jan 23 23:09:37.681: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 22.472647917s Jan 23 23:09:39.720: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 24.511282326s Jan 23 23:09:41.759: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 26.550400496s Jan 23 23:09:43.797: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 28.588748872s Jan 23 23:09:45.836: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 30.627479911s Jan 23 23:09:47.875: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 32.66636469s Jan 23 23:09:49.949: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 34.740777327s Jan 23 23:09:51.991: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 36.78268125s Jan 23 23:09:54.033: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 38.824549237s Jan 23 23:09:56.072: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 40.863260317s Jan 23 23:09:58.111: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 42.902353645s Jan 23 23:10:00.150: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 44.941161849s Jan 23 23:10:02.189: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 46.98011663s Jan 23 23:10:04.228: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 49.019816222s Jan 23 23:10:06.267: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 51.058805377s Jan 23 23:10:08.307: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 53.0981439s Jan 23 23:10:10.345: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 55.136734217s Jan 23 23:10:12.384: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 57.175934506s Jan 23 23:10:14.423: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 59.214458913s Jan 23 23:10:16.462: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.25320562s Jan 23 23:10:18.500: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.291380237s Jan 23 23:10:20.539: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.330234803s Jan 23 23:10:22.577: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.368922811s Jan 23 23:10:24.617: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.408917445s Jan 23 23:10:26.657: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.448497663s Jan 23 23:10:28.696: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.487374313s Jan 23 23:10:30.739: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.530433648s Jan 23 23:10:32.778: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.569431422s Jan 23 23:10:34.821: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.612810394s Jan 23 23:10:36.862: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Running", Reason="", readiness=true. Elapsed: 1m21.653510555s Jan 23 23:10:38.900: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Running", Reason="", readiness=true. Elapsed: 1m23.692014423s Jan 23 23:10:40.939: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Running", Reason="", readiness=true. Elapsed: 1m25.730866045s Jan 23 23:10:42.978: INFO: Pod "pvc-snapshottable-tester-st5wz": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m27.769684993s �[1mSTEP�[0m: Saw pod success Jan 23 23:10:42.978: INFO: Pod "pvc-snapshottable-tester-st5wz" satisfied condition "Succeeded or Failed" Jan 23 23:10:43.137: INFO: Pod pvc-snapshottable-tester-st5wz has the following logs: Jan 23 23:10:43.137: INFO: Deleting pod "pvc-snapshottable-tester-st5wz" in namespace "snapshotting-1686" Jan 23 23:10:43.191: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-st5wz" to be fully deleted Jan 23 23:10:43.229: INFO: Waiting up to 5m0s for PersistentVolumeClaims [csi-gcepd-sc-windows4n75k] to have phase Bound Jan 23 23:10:43.267: INFO: PersistentVolumeClaim csi-gcepd-sc-windows4n75k found and phase=Bound (38.001739ms) �[1mSTEP�[0m: checking the claim �[1mSTEP�[0m: checking the PV [BeforeEach] /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:190 �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jan 23 23:10:43.473: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-92nq5 to become ready Jan 23 23:10:43.526: INFO: VolumeSnapshot snapshot-92nq5 found but is not ready. Jan 23 23:10:45.572: INFO: VolumeSnapshot snapshot-92nq5 found but is not ready. Jan 23 23:10:47.616: INFO: VolumeSnapshot snapshot-92nq5 found but is not ready. Jan 23 23:10:49.656: INFO: VolumeSnapshot snapshot-92nq5 found but is not ready. Jan 23 23:10:51.695: INFO: VolumeSnapshot snapshot-92nq5 found but is not ready. Jan 23 23:10:53.734: INFO: VolumeSnapshot snapshot-92nq5 found but is not ready. Jan 23 23:10:55.772: INFO: VolumeSnapshot snapshot-92nq5 found but is not ready. Jan 23 23:10:57.811: INFO: VolumeSnapshot snapshot-92nq5 found but is not ready. Jan 23 23:10:59.849: INFO: VolumeSnapshot snapshot-92nq5 found and is ready Jan 23 23:10:59.849: INFO: WaitUntil finished successfully after 16.37590684s Jan 23 23:10:59.888: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-bf12d769-0165-4ec9-b018-328214c47da9 creationTime:2021-01-23T23:10:44Z readyToUse:true restoreSize:5Gi] Jan 23 23:10:59.888: INFO: snapshotContentName snapcontent-bf12d769-0165-4ec9-b018-328214c47da9 �[1mSTEP�[0m: updating the snapshot content deletion policy to retain �[1mSTEP�[0m: recording the volume handle and snapshotHandle Jan 23 23:10:59.971: INFO: Recording snapshot handle: projects/k8s-jkns-gci-gce-alpha-1-6/global/snapshots/snapshot-bf12d769-0165-4ec9-b018-328214c47da9 �[1mSTEP�[0m: deleting the snapshot and snapshot content �[1mSTEP�[0m: checking the Snapshot has been deleted Jan 23 23:11:00.013: INFO: Waiting up to 5m0s for volumesnapshots snapshotting-1686 to be deleted Jan 23 23:11:00.051: INFO: volumesnapshots snapshotting-1686 is not found in namespace snapshot-92nq5 and has been deleted Jan 23 23:11:00.051: INFO: WaitUntil finished successfully after 38.000595ms �[1mSTEP�[0m: checking the Snapshot content has been deleted Jan 23 23:11:00.106: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-bf12d769-0165-4ec9-b018-328214c47da9 to be deleted Jan 23 23:11:00.143: INFO: volumesnapshotcontents snapcontent-bf12d769-0165-4ec9-b018-328214c47da9 is not found and has been deleted Jan 23 23:11:00.143: INFO: WaitUntil finished successfully after 37.35875ms �[1mSTEP�[0m: creating a snapshot content with the snapshot handle �[1mSTEP�[0m: creating a snapshot with that snapshot content Jan 23 23:11:00.230: INFO: Waiting up to 5m0s for VolumeSnapshot pre-provisioned-snapshot-083a5659-fa67-44f9-a2ad-e1faec0067d8 to become ready Jan 23 23:11:00.268: INFO: VolumeSnapshot pre-provisioned-snapshot-083a5659-fa67-44f9-a2ad-e1faec0067d8 found but is not ready. Jan 23 23:11:02.307: INFO: VolumeSnapshot pre-provisioned-snapshot-083a5659-fa67-44f9-a2ad-e1faec0067d8 found and is ready Jan 23 23:11:02.307: INFO: WaitUntil finished successfully after 2.076918099s �[1mSTEP�[0m: getting the snapshot and snapshot content [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: Modifying source data test �[1mSTEP�[0m: modifying the data in the source PVC Jan 23 23:11:02.501: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-g28hj" in namespace "snapshotting-1686" to be "Succeeded or Failed" Jan 23 23:11:02.539: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 37.952231ms Jan 23 23:11:04.578: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.07727968s Jan 23 23:11:06.618: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.117330977s Jan 23 23:11:08.657: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.156070656s Jan 23 23:11:10.697: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.196278874s Jan 23 23:11:12.735: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.234600095s Jan 23 23:11:14.774: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 12.273588859s Jan 23 23:11:16.813: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 14.312049098s Jan 23 23:11:18.852: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 16.350956741s Jan 23 23:11:20.890: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 18.389293704s Jan 23 23:11:22.929: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 20.427730347s Jan 23 23:11:24.972: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 22.471310863s Jan 23 23:11:27.010: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 24.509318203s Jan 23 23:11:29.049: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 26.548036019s Jan 23 23:11:31.087: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 28.586564441s Jan 23 23:11:33.126: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 30.625225145s Jan 23 23:11:35.165: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 32.663990582s Jan 23 23:11:37.203: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 34.702459964s Jan 23 23:11:39.242: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 36.741024449s Jan 23 23:11:41.281: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 38.779734991s Jan 23 23:11:43.319: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 40.818147314s Jan 23 23:11:45.357: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 42.8565777s Jan 23 23:11:47.396: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 44.895199017s Jan 23 23:11:49.435: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 46.934348697s Jan 23 23:11:51.474: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 48.973166588s Jan 23 23:11:53.513: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Pending", Reason="", readiness=false. Elapsed: 51.011976642s Jan 23 23:11:55.552: INFO: Pod "pvc-snapshottable-data-tester-g28hj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 53.051068578s �[1mSTEP�[0m: Saw pod success Jan 23 23:11:55.552: INFO: Pod "pvc-snapshottable-data-tester-g28hj" satisfied condition "Succeeded or Failed" Jan 23 23:11:55.663: INFO: Pod pvc-snapshottable-data-tester-g28hj has the following logs: Jan 23 23:11:55.663: INFO: Deleting pod "pvc-snapshottable-data-tester-g28hj" in namespace "snapshotting-1686" Jan 23 23:11:55.713: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-g28hj" to be fully deleted �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the claim Jan 23 23:13:05.918: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-1686 exec restored-pvc-tester-zkztx --namespace=snapshotting-1686 -- powershell /c type /mnt/test/data' Jan 23 23:13:07.417: INFO: stderr: "" Jan 23 23:13:07.417: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:13:09.417: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-1686 exec restored-pvc-tester-zkztx --namespace=snapshotting-1686 -- powershell /c type /mnt/test/data' Jan 23 23:13:12.221: INFO: stderr: "" Jan 23 23:13:12.221: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:13:14.221: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-1686 exec restored-pvc-tester-zkztx --namespace=snapshotting-1686 -- powershell /c type /mnt/test/data' Jan 23 23:13:15.738: INFO: stderr: "" Jan 23 23:13:15.738: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:13:17.738: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-1686 exec restored-pvc-tester-zkztx --namespace=snapshotting-1686 -- powershell /c type /mnt/test/data' Jan 23 23:13:20.839: INFO: stderr: "" Jan 23 23:13:20.839: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:13:22.839: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-1686 exec restored-pvc-tester-zkztx --namespace=snapshotting-1686 -- powershell /c type /mnt/test/data' Jan 23 23:13:27.629: INFO: stderr: "" Jan 23 23:13:27.629: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:13:29.629: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-1686 exec restored-pvc-tester-zkztx --namespace=snapshotting-1686 -- powershell /c type /mnt/test/data' Jan 23 23:13:32.245: INFO: stderr: "" Jan 23 23:13:32.245: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:13:34.246: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-1686 exec restored-pvc-tester-zkztx --namespace=snapshotting-1686 -- powershell /c type /mnt/test/data' Jan 23 23:13:38.900: INFO: stderr: "" Jan 23 23:13:38.900: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:13:40.900: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-1686 exec restored-pvc-tester-zkztx --namespace=snapshotting-1686 -- powershell /c type /mnt/test/data' Jan 23 23:13:46.197: INFO: stderr: "" Jan 23 23:13:46.197: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:13:48.198: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-1686 exec restored-pvc-tester-zkztx --namespace=snapshotting-1686 -- powershell /c type /mnt/test/data' Jan 23 23:13:53.407: INFO: stderr: "" Jan 23 23:13:53.407: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:13:55.407: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-1686 exec restored-pvc-tester-zkztx --namespace=snapshotting-1686 -- powershell /c type /mnt/test/data' Jan 23 23:14:02.270: INFO: stderr: "" Jan 23 23:14:02.270: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:14:04.270: INFO: Running '/tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/bin/kubectl --server=https://35.227.153.143 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-1686 exec restored-pvc-tester-zkztx --namespace=snapshotting-1686 -- powershell /c type /mnt/test/data' Jan 23 23:14:08.623: INFO: stderr: "" Jan 23 23:14:08.624: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 23 23:14:10.624: FAIL: Unexpected error: <*errors.errorString | 0xc00394c870>: { s: "Failed to find \"hello from snapshotting-1686 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-1686 namespace", last result: "���������������������������������������� " occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.5.2() /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268 +0x1254 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003e76480) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc003e76480) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc003e76480, 0x4ff25b0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] volume snapshot controller /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:179 Jan 23 23:14:10.828: INFO: Pod restored-pvc-tester-zkztx has the following logs: Jan 23 23:14:10.828: INFO: Deleting pod "restored-pvc-tester-zkztx" in namespace "snapshotting-1686" Jan 23 23:14:10.871: INFO: Wait up to 5m0s for pod "restored-pvc-tester-zkztx" to be fully deleted Jan 23 23:14:24.964: INFO: deleting claim "snapshotting-1686"/"pvc-lr2lc" Jan 23 23:14:25.005: INFO: deleting snapshot "snapshotting-1686"/"pre-provisioned-snapshot-083a5659-fa67-44f9-a2ad-e1faec0067d8" Jan 23 23:14:25.062: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:pre-provisioned-snapcontent-083a5659-fa67-44f9-a2ad-e1faec0067d8 creationTime:2021-01-23T23:10:44Z readyToUse:true restoreSize:5Gi] Jan 23 23:14:25.062: INFO: snapshotContentName pre-provisioned-snapcontent-083a5659-fa67-44f9-a2ad-e1faec0067d8 Jan 23 23:14:25.149: INFO: Waiting up to 5m0s for volumesnapshotcontents pre-provisioned-snapcontent-083a5659-fa67-44f9-a2ad-e1faec0067d8 to be deleted Jan 23 23:14:25.220: INFO: volumesnapshotcontents pre-provisioned-snapcontent-083a5659-fa67-44f9-a2ad-e1faec0067d8 has been found and is not deleted Jan 23 23:14:27.274: INFO: volumesnapshotcontents pre-provisioned-snapcontent-083a5659-fa67-44f9-a2ad-e1faec0067d8 has been found and is not deleted Jan 23 23:14:29.314: INFO: volumesnapshotcontents pre-provisioned-snapcontent-083a5659-fa67-44f9-a2ad-e1faec0067d8 has been found and is not deleted Jan 23 23:14:31.361: INFO: volumesnapshotcontents pre-provisioned-snapcontent-083a5659-fa67-44f9-a2ad-e1faec0067d8 has been found and is not deleted Jan 23 23:14:33.416: INFO: volumesnapshotcontents pre-provisioned-snapcontent-083a5659-fa67-44f9-a2ad-e1faec0067d8 is not found and has been deleted Jan 23 23:14:33.416: INFO: WaitUntil finished successfully after 8.26756001s Jan 23 23:14:33.416: INFO: deleting snapshot content "pre-provisioned-snapcontent-083a5659-fa67-44f9-a2ad-e1faec0067d8" Jan 23 23:14:33.468: INFO: deleting snapshot class "snapshotting-1686-vscp9s82" Jan 23 23:14:33.545: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-1686-vscp9s82 to be deleted Jan 23 23:14:33.615: INFO: volumesnapshotclasses snapshotting-1686-vscp9s82 is not found and has been deleted Jan 23 23:14:33.615: INFO: WaitUntil finished successfully after 69.987143ms �[1mSTEP�[0m: Deleting pvc Jan 23 23:14:33.704: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windows4n75k" Jan 23 23:14:33.745: INFO: Waiting up to 5m0s for PersistentVolume pvc-bbda89a6-7aff-4e16-ae13-e4a52a32543a to get deleted Jan 23 23:14:33.809: INFO: PersistentVolume pvc-bbda89a6-7aff-4e16-ae13-e4a52a32543a found and phase=Released (64.35632ms) Jan 23 23:14:38.849: INFO: PersistentVolume pvc-bbda89a6-7aff-4e16-ae13-e4a52a32543a was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp887078980/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-1686". �[1mSTEP�[0m: Found 26 events. Jan 23 23:14:38.935: INFO: At 2021-01-23 23:09:15 +0000 UTC - event for csi-gcepd-sc-windows4n75k: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 23 23:14:38.935: INFO: At 2021-01-23 23:09:15 +0000 UTC - event for csi-gcepd-sc-windows4n75k: {pd.csi.storage.gke.io_e2e-38e8f98620-9cdc3-minion-group-kk4b_9fa2d7f6-b31b-45c3-897d-bf1f8a71bcb0 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-1686/csi-gcepd-sc-windows4n75k" Jan 23 23:14:38.935: INFO: At 2021-01-23 23:09:15 +0000 UTC - event for csi-gcepd-sc-windows4n75k: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 23 23:14:38.935: INFO: At 2021-01-23 23:09:19 +0000 UTC - event for csi-gcepd-sc-windows4n75k: {pd.csi.storage.gke.io_e2e-38e8f98620-9cdc3-minion-group-kk4b_9fa2d7f6-b31b-45c3-897d-bf1f8a71bcb0 } ProvisioningSucceeded: Successfully provisioned volume pvc-bbda89a6-7aff-4e16-ae13-e4a52a32543a Jan 23 23:14:38.935: INFO: At 2021-01-23 23:09:19 +0000 UTC - event for pvc-snapshottable-tester-st5wz: {default-scheduler } Scheduled: Successfully assigned snapshotting-1686/pvc-snapshottable-tester-st5wz to e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:14:38.935: INFO: At 2021-01-23 23:09:31 +0000 UTC - event for pvc-snapshottable-tester-st5wz: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-bbda89a6-7aff-4e16-ae13-e4a52a32543a" Jan 23 23:14:38.935: INFO: At 2021-01-23 23:10:26 +0000 UTC - event for pvc-snapshottable-tester-st5wz: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "f8e9537f49fa39befadc934384758468f5ac5ad522f3913227865868b24760b1" network for pod "pvc-snapshottable-tester-st5wz": networkPlugin cni failed to set up pod "pvc-snapshottable-tester-st5wz_snapshotting-1686" network: error while executing ADD command: error while ProvisionEndpoint(f8e9537f49fa39befadc934384758468f5ac5ad522f3913227865868b24760b1_l2bridge,6ECC1478-0795-4C9F-BAF7-EF5B50326E4C,f8e9537f49fa39befadc934384758468f5ac5ad522f3913227865868b24760b1): Element not found. Jan 23 23:14:38.935: INFO: At 2021-01-23 23:10:27 +0000 UTC - event for pvc-snapshottable-tester-st5wz: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 23 23:14:38.935: INFO: At 2021-01-23 23:10:31 +0000 UTC - event for pvc-snapshottable-tester-st5wz: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Created: Created container volume-tester Jan 23 23:14:38.935: INFO: At 2021-01-23 23:10:31 +0000 UTC - event for pvc-snapshottable-tester-st5wz: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 23 23:14:38.935: INFO: At 2021-01-23 23:10:32 +0000 UTC - event for pvc-snapshottable-tester-st5wz: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Started: Started container volume-tester Jan 23 23:14:38.935: INFO: At 2021-01-23 23:10:43 +0000 UTC - event for snapshot-92nq5: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-1686/snapshot-92nq5 to be created by the CSI driver. Jan 23 23:14:38.935: INFO: At 2021-01-23 23:11:02 +0000 UTC - event for pvc-snapshottable-data-tester-g28hj: {default-scheduler } Scheduled: Successfully assigned snapshotting-1686/pvc-snapshottable-data-tester-g28hj to e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:14:38.935: INFO: At 2021-01-23 23:11:40 +0000 UTC - event for pvc-snapshottable-data-tester-g28hj: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Created: Created container volume-tester Jan 23 23:14:38.935: INFO: At 2021-01-23 23:11:40 +0000 UTC - event for pvc-snapshottable-data-tester-g28hj: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 23 23:14:38.935: INFO: At 2021-01-23 23:11:42 +0000 UTC - event for pvc-snapshottable-data-tester-g28hj: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Started: Started container volume-tester Jan 23 23:14:38.935: INFO: At 2021-01-23 23:11:55 +0000 UTC - event for pvc-lr2lc: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 23 23:14:38.935: INFO: At 2021-01-23 23:11:55 +0000 UTC - event for pvc-lr2lc: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 23 23:14:38.935: INFO: At 2021-01-23 23:11:55 +0000 UTC - event for pvc-lr2lc: {pd.csi.storage.gke.io_e2e-38e8f98620-9cdc3-minion-group-kk4b_9fa2d7f6-b31b-45c3-897d-bf1f8a71bcb0 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-1686/pvc-lr2lc" Jan 23 23:14:38.935: INFO: At 2021-01-23 23:12:17 +0000 UTC - event for pvc-lr2lc: {pd.csi.storage.gke.io_e2e-38e8f98620-9cdc3-minion-group-kk4b_9fa2d7f6-b31b-45c3-897d-bf1f8a71bcb0 } ProvisioningSucceeded: Successfully provisioned volume pvc-ec69454b-f564-4aca-85f4-1337d36551f3 Jan 23 23:14:38.935: INFO: At 2021-01-23 23:12:18 +0000 UTC - event for restored-pvc-tester-zkztx: {default-scheduler } Scheduled: Successfully assigned snapshotting-1686/restored-pvc-tester-zkztx to e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:14:38.935: INFO: At 2021-01-23 23:12:30 +0000 UTC - event for restored-pvc-tester-zkztx: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-ec69454b-f564-4aca-85f4-1337d36551f3" Jan 23 23:14:38.935: INFO: At 2021-01-23 23:12:59 +0000 UTC - event for restored-pvc-tester-zkztx: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 23 23:14:38.935: INFO: At 2021-01-23 23:12:59 +0000 UTC - event for restored-pvc-tester-zkztx: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Created: Created container volume-tester Jan 23 23:14:38.935: INFO: At 2021-01-23 23:13:01 +0000 UTC - event for restored-pvc-tester-zkztx: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Started: Started container volume-tester Jan 23 23:14:38.935: INFO: At 2021-01-23 23:14:10 +0000 UTC - event for restored-pvc-tester-zkztx: {kubelet e2e-38e8f98620-9cdc3-windows-node-group-nxd1} Killing: Stopping container volume-tester Jan 23 23:14:38.975: INFO: POD NODE PHASE GRACE CONDITIONS Jan 23 23:14:38.975: INFO: Jan 23 23:14:39.023: INFO: Logging node info for node e2e-38e8f98620-9cdc3-master Jan 23 23:14:39.062: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-master 3e77ba53-43f9-4513-aa17-db3cc1d4b206 8911 0 2021-01-23 22:19:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-23 22:19:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2021-01-23 23:00:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-23 23:04:06 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3866853376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3604709376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:19:17 +0000 UTC,LastTransitionTime:2021-01-23 22:19:17 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.227.153.143,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-master.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-master.c.k8s-jkns-gci-gce-alpha-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:edeb9f32b2630f47cc3b499c986b246f,SystemUUID:edeb9f32-b263-0f47-cc3b-499c986b246f,BootID:11afb933-8d2f-432c-ab86-319918cea8e9,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.21.0-alpha.1.277_676079605da916],SizeBytes:123005230,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.21.0-alpha.1.277_676079605da916],SizeBytes:117528906,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:70314536,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.21.0-alpha.1.277_676079605da916],SizeBytes:47716661,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 23 23:14:39.063: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-master Jan 23 23:14:39.104: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-master Jan 23 23:14:39.166: INFO: kube-scheduler-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:17:49 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:39.166: INFO: Container kube-scheduler ready: true, restart count 0 Jan 23 23:14:39.166: INFO: kube-addon-manager-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:18:55 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:39.166: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 23 23:14:39.166: INFO: l7-lb-controller-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:19:05 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:39.166: INFO: Container l7-lb-controller ready: true, restart count 0 Jan 23 23:14:39.166: INFO: metadata-proxy-v0.1-jsfs4 started at 2021-01-23 22:19:46 +0000 UTC (0+2 container statuses recorded) Jan 23 23:14:39.166: INFO: Container metadata-proxy ready: true, restart count 0 Jan 23 23:14:39.166: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 23 23:14:39.166: INFO: csi-gce-pd-node-jqcl5 started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:14:39.166: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:14:39.166: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 23 23:14:39.166: INFO: etcd-server-events-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:17:59 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:39.166: INFO: Container etcd-container ready: true, restart count 0 Jan 23 23:14:39.166: INFO: etcd-server-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:18:09 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:39.166: INFO: Container etcd-container ready: true, restart count 0 Jan 23 23:14:39.166: INFO: kube-apiserver-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:18:19 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:39.166: INFO: Container kube-apiserver ready: true, restart count 0 Jan 23 23:14:39.166: INFO: kube-controller-manager-e2e-38e8f98620-9cdc3-master started at 2021-01-23 22:18:29 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:39.166: INFO: Container kube-controller-manager ready: true, restart count 0 W0123 23:14:39.229336 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:14:39.824: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-master Jan 23 23:14:39.824: INFO: Logging node info for node e2e-38e8f98620-9cdc3-minion-group-glhc Jan 23 23:14:39.863: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-minion-group-glhc 29738114-e007-415f-a860-8bc897de518e 8915 0 2021-01-23 22:19:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-minion-group-glhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-minion-group-glhc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-23 22:19:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-23 22:19:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-23 23:00:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-23 23:04:06 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-minion-group-glhc,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-23 23:09:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-23 23:09:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-23 23:09:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-23 23:09:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-23 23:09:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-23 23:09:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-23 23:09:41 +0000 UTC,LastTransitionTime:2021-01-23 22:19:31 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:19:27 +0000 UTC,LastTransitionTime:2021-01-23 22:19:27 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.6,},NodeAddress{Type:ExternalIP,Address:35.227.190.27,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-minion-group-glhc.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-minion-group-glhc.c.k8s-jkns-gci-gce-alpha-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d51eb9e71d15d2f95c4f6a26324f7265,SystemUUID:d51eb9e7-1d15-d2f9-5c4f-6a26324f7265,BootID:8d416c16-deb3-486e-b86c-30df795e0989,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.277_676079605da916],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:70314536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:a494ff6ec10e05a454458fbf44247d93c9b3a0d983a00b538e442f353b7030c8 k8s.gcr.io/sig-storage/snapshot-controller:v3.0.2],SizeBytes:17461280,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 23 23:14:39.863: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-minion-group-glhc Jan 23 23:14:39.904: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-minion-group-glhc Jan 23 23:14:39.979: INFO: kube-proxy-e2e-38e8f98620-9cdc3-minion-group-glhc started at 2021-01-23 22:19:27 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:39.979: INFO: Container kube-proxy ready: true, restart count 0 Jan 23 23:14:39.979: INFO: metadata-proxy-v0.1-xr8n2 started at 2021-01-23 22:19:27 +0000 UTC (0+2 container statuses recorded) Jan 23 23:14:39.979: INFO: Container metadata-proxy ready: true, restart count 0 Jan 23 23:14:39.979: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 23 23:14:39.979: INFO: csi-gce-pd-node-kljkr started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:14:39.979: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:14:39.979: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 23 23:14:39.979: INFO: volume-snapshot-controller-0 started at 2021-01-23 22:19:41 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:39.979: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jan 23 23:14:39.979: INFO: kube-dns-autoscaler-76478fcf46-xrbjs started at 2021-01-23 22:19:41 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:39.979: INFO: Container autoscaler ready: true, restart count 0 Jan 23 23:14:39.979: INFO: coredns-6954c77b9b-4t4sq started at 2021-01-23 22:19:50 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:39.979: INFO: Container coredns ready: true, restart count 0 W0123 23:14:40.023760 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:14:40.253: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-minion-group-glhc Jan 23 23:14:40.253: INFO: Logging node info for node e2e-38e8f98620-9cdc3-minion-group-kk4b Jan 23 23:14:40.294: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-minion-group-kk4b 5ecd4da2-2160-4e5d-9e06-71d27ed35509 10166 0 2021-01-23 22:19:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-minion-group-kk4b kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-minion-group-kk4b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-23 22:19:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.5.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-23 22:19:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-23 23:00:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-23 23:04:06 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.5.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-minion-group-kk4b,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.5.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823962112 0} {<nil>} 7640588Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561818112 0} {<nil>} 7384588Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-23 23:14:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-23 23:14:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-23 23:14:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-23 23:14:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-23 23:14:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-23 23:14:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-23 23:14:35 +0000 UTC,LastTransitionTime:2021-01-23 22:19:26 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:19:25 +0000 UTC,LastTransitionTime:2021-01-23 22:19:25 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:10:30 +0000 UTC,LastTransitionTime:2021-01-23 22:19:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.7,},NodeAddress{Type:ExternalIP,Address:35.230.85.214,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-minion-group-kk4b.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-minion-group-kk4b.c.k8s-jkns-gci-gce-alpha-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0f2d04d5b7e9c396aacef591ee8a232d,SystemUUID:0f2d04d5-b7e9-c396-aace-f591ee8a232d,BootID:e958037b-0884-4ed8-9d3d-7f0345b4eaa5,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.277_676079605da916],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:70314536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:bec571992d40203edcd056ac0b0d97003887ee5e4be144c41932d18639673b03 k8s.gcr.io/sig-storage/csi-provisioner:v2.0.4],SizeBytes:20428748,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:e5ce22ddc2a6fbc9b5729dbcfaf1159c4b0d48dad62ddd1b93503c1348e4a406 k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.1],SizeBytes:19498883,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:ca160717df7f6b7964c936faf608b914f2277363e6d708ea2e2dbbf2c5f56a83 k8s.gcr.io/sig-storage/csi-resizer:v1.0.1],SizeBytes:19463877,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:7495d30800fb3ef22f3dc6d5fe9a0a6ec40ba32a2bdc0cf5e7fcaa507adc921e k8s.gcr.io/sig-storage/csi-attacher:v3.0.1],SizeBytes:19460260,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 23 23:14:40.294: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-minion-group-kk4b Jan 23 23:14:40.371: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-minion-group-kk4b Jan 23 23:14:40.451: INFO: csi-gce-pd-node-5769z started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:14:40.451: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:14:40.451: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 23 23:14:40.451: INFO: kube-proxy-e2e-38e8f98620-9cdc3-minion-group-kk4b started at 2021-01-23 22:19:25 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:40.451: INFO: Container kube-proxy ready: true, restart count 0 Jan 23 23:14:40.451: INFO: metadata-proxy-v0.1-bj49g started at 2021-01-23 22:19:25 +0000 UTC (0+2 container statuses recorded) Jan 23 23:14:40.451: INFO: Container metadata-proxy ready: true, restart count 0 Jan 23 23:14:40.451: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 23 23:14:40.451: INFO: l7-default-backend-6dd8477499-trvcq started at 2021-01-23 22:19:41 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:40.451: INFO: Container default-http-backend ready: true, restart count 0 Jan 23 23:14:40.451: INFO: coredns-6954c77b9b-tm78c started at 2021-01-23 22:19:41 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:40.451: INFO: Container coredns ready: true, restart count 0 Jan 23 23:14:40.451: INFO: csi-gce-pd-controller-7bccfb5d44-7gdrx started at 2021-01-23 22:59:51 +0000 UTC (0+5 container statuses recorded) Jan 23 23:14:40.451: INFO: Container csi-attacher ready: true, restart count 0 Jan 23 23:14:40.451: INFO: Container csi-provisioner ready: true, restart count 0 Jan 23 23:14:40.451: INFO: Container csi-resizer ready: true, restart count 0 Jan 23 23:14:40.451: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 23 23:14:40.451: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 23 23:14:40.451: INFO: metrics-server-v0.3.6-8b98f98c9-kzbnd started at 2021-01-23 22:20:12 +0000 UTC (0+2 container statuses recorded) Jan 23 23:14:40.451: INFO: Container metrics-server ready: true, restart count 0 Jan 23 23:14:40.451: INFO: Container metrics-server-nanny ready: true, restart count 0 W0123 23:14:40.509670 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:14:41.041: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-minion-group-kk4b Jan 23 23:14:41.041: INFO: Logging node info for node e2e-38e8f98620-9cdc3-windows-node-group-g5jr Jan 23 23:14:41.198: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-windows-node-group-g5jr 96c9c63f-b8e9-4d89-9b54-624584d57e49 9773 0 2021-01-23 22:24:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-windows-node-group-g5jr kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-windows-node-group-g5jr"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-23 23:04:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-23 23:04:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-windows-node-group-g5jr,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:24:47 +0000 UTC,LastTransitionTime:2021-01-23 22:24:47 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:12:49 +0000 UTC,LastTransitionTime:2021-01-23 22:24:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:12:49 +0000 UTC,LastTransitionTime:2021-01-23 22:24:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:12:49 +0000 UTC,LastTransitionTime:2021-01-23 22:24:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:12:49 +0000 UTC,LastTransitionTime:2021-01-23 22:24:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.230.101.42,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-windows-node-group-g5jr.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-windows-node-group-g5jr,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-38e8f98620-9cdc3-windows-node-group-g5jr,SystemUUID:FB18DA59-CD6F-B2CA-9CE5-893B249DE0C3,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-3ebae861-ea6e-4640-8c33-046fd9968920 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-a5b5cbe2-8903-4ed0-a0a9-983d49548513],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-a5b5cbe2-8903-4ed0-a0a9-983d49548513,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-3ebae861-ea6e-4640-8c33-046fd9968920,DevicePath:,},},Config:nil,},} Jan 23 23:14:41.198: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-windows-node-group-g5jr Jan 23 23:14:41.303: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-windows-node-group-g5jr Jan 23 23:14:41.436: INFO: csi-gce-pd-node-win-c2hlr started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:14:41.436: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:14:41.436: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 23 23:14:41.436: INFO: pod-subpath-test-dynamicpv-lsqp started at 2021-01-23 23:12:47 +0000 UTC (1+2 container statuses recorded) Jan 23 23:14:41.436: INFO: Init container test-init-subpath-dynamicpv-lsqp ready: false, restart count 0 Jan 23 23:14:41.436: INFO: Container test-container-subpath-dynamicpv-lsqp ready: false, restart count 0 Jan 23 23:14:41.436: INFO: Container test-container-volume-dynamicpv-lsqp ready: false, restart count 0 W0123 23:14:41.505371 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:14:47.140: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-windows-node-group-g5jr Jan 23 23:14:47.140: INFO: Logging node info for node e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:14:47.182: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-windows-node-group-nxd1 2bdfbd92-17b9-4c27-a60f-b631dd55d251 9866 0 2021-01-23 22:24:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-windows-node-group-nxd1 kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-windows-node-group-nxd1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-23 23:04:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-23 23:12:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-windows-node-group-nxd1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:24:43 +0000 UTC,LastTransitionTime:2021-01-23 22:24:43 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:13:00 +0000 UTC,LastTransitionTime:2021-01-23 22:24:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:13:00 +0000 UTC,LastTransitionTime:2021-01-23 22:24:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:13:00 +0000 UTC,LastTransitionTime:2021-01-23 22:24:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:13:00 +0000 UTC,LastTransitionTime:2021-01-23 22:24:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.235.105,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-windows-node-group-nxd1.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-windows-node-group-nxd1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-38e8f98620-9cdc3-windows-node-group-nxd1,SystemUUID:86179274-1E9D-D2E8-DA3D-7A0AC6C47BF4,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-1eb78192-575c-483f-bcaa-1f3041115051 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-203d73b8-e5f8-4a45-b01b-13d442c89226 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-ec69454b-f564-4aca-85f4-1337d36551f3],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-ec69454b-f564-4aca-85f4-1337d36551f3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-203d73b8-e5f8-4a45-b01b-13d442c89226,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-1eb78192-575c-483f-bcaa-1f3041115051,DevicePath:,},},Config:nil,},} Jan 23 23:14:47.182: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:14:47.223: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:14:47.346: INFO: csi-gce-pd-node-win-dm6qt started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:14:47.346: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:14:47.346: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 23 23:14:47.346: INFO: exec-volume-test-dynamicpv-bpzg started at 2021-01-23 23:12:59 +0000 UTC (0+1 container statuses recorded) Jan 23 23:14:47.346: INFO: Container exec-container-dynamicpv-bpzg ready: false, restart count 0 W0123 23:14:47.397592 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:14:52.274: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-windows-node-group-nxd1 Jan 23 23:14:52.274: INFO: Logging node info for node e2e-38e8f98620-9cdc3-windows-node-group-x4wl Jan 23 23:14:52.403: INFO: Node Info: &Node{ObjectMeta:{e2e-38e8f98620-9cdc3-windows-node-group-x4wl ae8b10e0-a000-4159-b12d-49a91e2dfbf3 9837 0 2021-01-23 22:24:24 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-38e8f98620-9cdc3-windows-node-group-x4wl kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/instances/e2e-38e8f98620-9cdc3-windows-node-group-x4wl"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-23 23:04:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-23 23:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha-1-6/us-west1-b/e2e-38e8f98620-9cdc3-windows-node-group-x4wl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-23 22:24:25 +0000 UTC,LastTransitionTime:2021-01-23 22:24:25 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-23 23:13:02 +0000 UTC,LastTransitionTime:2021-01-23 22:24:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-23 23:13:02 +0000 UTC,LastTransitionTime:2021-01-23 22:24:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-23 23:13:02 +0000 UTC,LastTransitionTime:2021-01-23 22:24:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-23 23:13:02 +0000 UTC,LastTransitionTime:2021-01-23 22:24:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:35.247.50.93,},NodeAddress{Type:InternalDNS,Address:e2e-38e8f98620-9cdc3-windows-node-group-x4wl.c.k8s-jkns-gci-gce-alpha-1-6.internal,},NodeAddress{Type:Hostname,Address:e2e-38e8f98620-9cdc3-windows-node-group-x4wl,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-38e8f98620-9cdc3-windows-node-group-x4wl,SystemUUID:959C1E36-9643-3B4F-8640-F4E058BACB3D,BootID:,KernelVersion:10.0.17763.1697,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.277+676079605da916,KubeProxyVersion:v1.21.0-alpha.1.277+676079605da916,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver@sha256:b9a22ffade6bc1978a3e8c712a540b64d0405d68127ab57089ab42c8a697f530 gcr.io/k8s-jkns-gci-gce-alpha-1-6/gcp-persistent-disk-csi-driver:2937eb3b-3959-4036-b311-6f67726813e3],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:68c9091e27bdf695e63d5adcb6118fd31cc31da7d72324b7ad5fea39df2a9a27 gcr.io/gke-release/pause-win:1.5.1],SizeBytes:4940443546,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-70f95c76-5f9e-41d3-bb0e-4e7586b03b44 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-8f342fb9-f10a-45f2-b6b6-beef1b3a4f19 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-f8f7fada-a7f7-47e7-9a8d-59b10e809786],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-8f342fb9-f10a-45f2-b6b6-beef1b3a4f19,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-f8f7fada-a7f7-47e7-9a8d-59b10e809786,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-gci-gce-alpha-1-6/zones/us-west1-b/disks/pvc-70f95c76-5f9e-41d3-bb0e-4e7586b03b44,DevicePath:,},},Config:nil,},} Jan 23 23:14:52.403: INFO: Logging kubelet events for node e2e-38e8f98620-9cdc3-windows-node-group-x4wl Jan 23 23:14:52.466: INFO: Logging pods the kubelet thinks is on node e2e-38e8f98620-9cdc3-windows-node-group-x4wl Jan 23 23:14:52.525: INFO: csi-gce-pd-node-win-tdrvh started at 2021-01-23 22:59:51 +0000 UTC (0+2 container statuses recorded) Jan 23 23:14:52.525: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 23 23:14:52.525: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 23 23:14:52.525: INFO: pod-subpath-test-dynamicpv-94p9 started at 2021-01-23 23:12:40 +0000 UTC (2+1 container statuses recorded) Jan 23 23:14:52.525: INFO: Init container init-volume-dynamicpv-94p9 ready: true, restart count 0 Jan 23 23:14:52.525: INFO: Init container test-init-volume-dynamicpv-94p9 ready: false, restart count 0 Jan 23 23:14:52.525: INFO: Container test-container-subpath-dynamicpv-94p9 ready: false, restart count 0 Jan 23 23:14:52.525: INFO: pod-subpath-test-dynamicpv-lh8v started at 2021-01-23 23:12:55 +0000 UTC (1+2 container statuses recorded) Jan 23 23:14:52.525: INFO: Init container test-init-subpath-dynamicpv-lh8v ready: false, restart count 0 Jan 23 23:14:52.525: INFO: Container test-container-subpath-dynamicpv-lh8v ready: false, restart count 0 Jan 23 23:14:52.525: INFO: Container test-container-volume-dynamicpv-lh8v ready: false, restart count 0 W0123 23:14:52.591356 69477 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 23 23:15:02.116: INFO: Latency metrics for node e2e-38e8f98620-9cdc3-windows-node-group-x4wl Jan 23 23:15:02.116: INFO: Waiting up to 3m0s for all (but 3) nodes to be ready �[1mSTEP�[0m: Destroying namespace "snapshotting-1686" for this suite.
Filter through log files | View test history on testgrid
Check APIReachability
Deferred TearDown
DumpClusterLogs
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion
Extract
TearDown
TearDown Previous
Timeout
Up
diffResources
list nodes
listResources After
listResources Before
listResources Down
listResources Up
test setup
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail in binding dynamic provisioned PV to PVC [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (delayed binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (immediate binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][sig-windows] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][sig-windows] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable-stress[Feature:VolumeSnapshotDataSource] should support snapshotting of many volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable-stress[Feature:VolumeSnapshotDataSource] should support snapshotting of many volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (xfs)][Slow] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to create pod by failing to mount volume [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should store data