ci-gce-pd-csi-driver-latest-k8s-master-windows-2019 #1352496972447092736
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 3 failed / 42 succeeded |
| Started | |
| Elapsed | 1h9m |
| Revision | master |
| job-version | v1.21.0-alpha.1.250+88c652c154c1e3 |
| revision | v1.21.0-alpha.1.250+88c652c154c1e3 |
error during /home/prow/go/src/sigs.k8s.io/gcp-compute-persistent-disk-csi-driver/test/run-windows-k8s-integration.sh: exit status 255
from junit_runner.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=External\sStorage\s\[Driver\:\scsi\-gcepd\-sc\-windows\]\s\[Testpattern\:\sDynamic\sSnapshot\s\(delete\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion$'
/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 Jan 22 06:52:00.886: Unexpected error: <*errors.errorString | 0xc002a8e030>: { s: "Failed to find \"hello from snapshotting-5703 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-5703 namespace", last result: "���������������������������������������� " occurred /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268from junit_pdcsi.xml
[BeforeEach] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 22 06:46:04.170: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] volume snapshot controller /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:176 Jan 22 06:46:04.364: INFO: Creating resource for dynamic PV Jan 22 06:46:04.364: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-5703-e2e-scl68h7 �[1mSTEP�[0m: creating a claim Jan 22 06:46:04.405: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: starting a pod to use the claim Jan 22 06:46:04.536: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-t264g" in namespace "snapshotting-5703" to be "Succeeded or Failed" Jan 22 06:46:04.587: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 50.329367ms Jan 22 06:46:06.626: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 2.089318445s Jan 22 06:46:08.665: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 4.128442186s Jan 22 06:46:10.704: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 6.168244268s Jan 22 06:46:12.744: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 8.207339915s Jan 22 06:46:14.783: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 10.246958053s Jan 22 06:46:16.822: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 12.285495739s Jan 22 06:46:18.861: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 14.324904669s Jan 22 06:46:20.901: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 16.36456018s Jan 22 06:46:22.942: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 18.405689305s Jan 22 06:46:24.981: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 20.444927928s Jan 22 06:46:27.021: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 22.484882853s Jan 22 06:46:29.065: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 24.528864302s Jan 22 06:46:31.104: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 26.568222149s Jan 22 06:46:33.143: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 28.607227768s Jan 22 06:46:35.183: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 30.646560902s Jan 22 06:46:37.223: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 32.686863798s Jan 22 06:46:39.262: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 34.726107339s Jan 22 06:46:41.302: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 36.765831956s Jan 22 06:46:43.342: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 38.805447013s Jan 22 06:46:45.382: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 40.845768996s Jan 22 06:46:47.423: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 42.886397183s Jan 22 06:46:49.462: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 44.925754533s Jan 22 06:46:51.501: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 46.964841297s Jan 22 06:46:53.540: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 49.004199084s Jan 22 06:46:55.581: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 51.04435003s Jan 22 06:46:57.620: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 53.084010564s Jan 22 06:46:59.660: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 55.123323844s Jan 22 06:47:01.699: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 57.16260848s Jan 22 06:47:03.745: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 59.208471878s Jan 22 06:47:05.800: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.264031609s Jan 22 06:47:07.839: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.303054851s Jan 22 06:47:09.879: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.342412383s Jan 22 06:47:11.918: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.38153683s Jan 22 06:47:13.957: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.420669289s Jan 22 06:47:15.996: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.459976174s Jan 22 06:47:18.065: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.529138565s Jan 22 06:47:20.104: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Running", Reason="", readiness=true. Elapsed: 1m15.568255261s Jan 22 06:47:22.145: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Running", Reason="", readiness=true. Elapsed: 1m17.608438536s Jan 22 06:47:24.184: INFO: Pod "pvc-snapshottable-tester-t264g": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m19.647610668s �[1mSTEP�[0m: Saw pod success Jan 22 06:47:24.184: INFO: Pod "pvc-snapshottable-tester-t264g" satisfied condition "Succeeded or Failed" Jan 22 06:47:24.250: INFO: Pod pvc-snapshottable-tester-t264g has the following logs: Jan 22 06:47:24.250: INFO: Deleting pod "pvc-snapshottable-tester-t264g" in namespace "snapshotting-5703" Jan 22 06:47:24.298: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-t264g" to be fully deleted Jan 22 06:47:24.336: INFO: Waiting up to 5m0s for PersistentVolumeClaims [csi-gcepd-sc-windowszwvcw] to have phase Bound Jan 22 06:47:24.376: INFO: PersistentVolumeClaim csi-gcepd-sc-windowszwvcw found and phase=Bound (39.248958ms) �[1mSTEP�[0m: checking the claim �[1mSTEP�[0m: checking the PV [BeforeEach] /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:190 �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jan 22 06:47:24.578: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-pw49p to become ready Jan 22 06:47:24.633: INFO: VolumeSnapshot snapshot-pw49p found but is not ready. Jan 22 06:47:26.673: INFO: VolumeSnapshot snapshot-pw49p found but is not ready. Jan 22 06:47:28.713: INFO: VolumeSnapshot snapshot-pw49p found but is not ready. Jan 22 06:47:30.754: INFO: VolumeSnapshot snapshot-pw49p found but is not ready. Jan 22 06:47:32.794: INFO: VolumeSnapshot snapshot-pw49p found but is not ready. Jan 22 06:47:34.834: INFO: VolumeSnapshot snapshot-pw49p found but is not ready. Jan 22 06:47:36.876: INFO: VolumeSnapshot snapshot-pw49p found but is not ready. Jan 22 06:47:38.916: INFO: VolumeSnapshot snapshot-pw49p found but is not ready. Jan 22 06:47:40.955: INFO: VolumeSnapshot snapshot-pw49p found but is not ready. Jan 22 06:47:42.995: INFO: VolumeSnapshot snapshot-pw49p found and is ready Jan 22 06:47:42.995: INFO: WaitUntil finished successfully after 18.417390627s Jan 22 06:47:43.038: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-85c3ddb3-46e8-489b-82ea-1ba338f9dd95 creationTime:2021-01-22T06:47:25Z readyToUse:true restoreSize:5Gi] Jan 22 06:47:43.038: INFO: snapshotContentName snapcontent-85c3ddb3-46e8-489b-82ea-1ba338f9dd95 [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: Modifying source data test �[1mSTEP�[0m: modifying the data in the source PVC Jan 22 06:47:43.196: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-dvhb5" in namespace "snapshotting-5703" to be "Succeeded or Failed" Jan 22 06:47:43.237: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 40.277956ms Jan 22 06:47:45.276: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.07982977s Jan 22 06:47:47.317: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.120143736s Jan 22 06:47:49.356: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.159550761s Jan 22 06:47:51.395: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.198676687s Jan 22 06:47:53.435: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.238015284s Jan 22 06:47:55.474: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 12.277459502s Jan 22 06:47:57.513: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 14.316828083s Jan 22 06:47:59.553: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.356075284s Jan 22 06:48:01.592: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 18.395154199s Jan 22 06:48:03.631: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 20.43409153s Jan 22 06:48:05.674: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 22.477815146s Jan 22 06:48:07.714: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 24.517233393s Jan 22 06:48:09.753: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 26.556583924s Jan 22 06:48:11.792: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 28.595889094s Jan 22 06:48:13.832: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.635278826s Jan 22 06:48:15.872: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 32.675492502s Jan 22 06:48:17.911: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 34.714820694s Jan 22 06:48:19.950: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 36.753859686s Jan 22 06:48:21.990: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 38.793528711s Jan 22 06:48:24.030: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 40.8334087s Jan 22 06:48:26.069: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 42.872674777s Jan 22 06:48:28.108: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 44.91186434s Jan 22 06:48:30.148: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 46.951384937s Jan 22 06:48:32.193: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 48.996958669s Jan 22 06:48:34.233: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 51.036321179s Jan 22 06:48:36.272: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 53.075023322s Jan 22 06:48:38.393: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 55.196588826s Jan 22 06:48:40.432: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 57.235397988s Jan 22 06:48:42.472: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 59.275286669s Jan 22 06:48:44.511: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.314807656s Jan 22 06:48:46.559: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.362373161s Jan 22 06:48:48.598: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.401880805s Jan 22 06:48:50.640: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.443097233s Jan 22 06:48:52.679: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.482873665s Jan 22 06:48:54.719: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.522127046s Jan 22 06:48:56.758: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.561320953s Jan 22 06:48:58.797: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.600594775s Jan 22 06:49:00.836: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.63991438s Jan 22 06:49:02.876: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Running", Reason="", readiness=true. Elapsed: 1m19.679183975s Jan 22 06:49:04.915: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Running", Reason="", readiness=true. Elapsed: 1m21.718846136s Jan 22 06:49:06.959: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Running", Reason="", readiness=true. Elapsed: 1m23.762028542s Jan 22 06:49:09.001: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Running", Reason="", readiness=true. Elapsed: 1m25.804216441s Jan 22 06:49:11.043: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Running", Reason="", readiness=true. Elapsed: 1m27.846959581s Jan 22 06:49:13.086: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Running", Reason="", readiness=true. Elapsed: 1m29.889363002s Jan 22 06:49:15.134: INFO: Pod "pvc-snapshottable-data-tester-dvhb5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m31.937154368s �[1mSTEP�[0m: Saw pod success Jan 22 06:49:15.134: INFO: Pod "pvc-snapshottable-data-tester-dvhb5" satisfied condition "Succeeded or Failed" Jan 22 06:49:15.644: INFO: Pod pvc-snapshottable-data-tester-dvhb5 has the following logs: Jan 22 06:49:15.644: INFO: Deleting pod "pvc-snapshottable-data-tester-dvhb5" in namespace "snapshotting-5703" Jan 22 06:49:15.697: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-dvhb5" to be fully deleted �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the claim Jan 22 06:50:55.941: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:02.670: INFO: stderr: "" Jan 22 06:51:02.670: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:51:04.670: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:06.771: INFO: stderr: "" Jan 22 06:51:06.772: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:51:08.772: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:11.250: INFO: stderr: "" Jan 22 06:51:11.250: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:51:13.250: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:15.587: INFO: stderr: "" Jan 22 06:51:15.587: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:51:17.587: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:22.004: INFO: stderr: "" Jan 22 06:51:22.004: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:51:24.004: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:27.766: INFO: stderr: "" Jan 22 06:51:27.766: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:51:29.767: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:32.973: INFO: stderr: "" Jan 22 06:51:32.973: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:51:34.973: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:38.281: INFO: stderr: "" Jan 22 06:51:38.281: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:51:40.281: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:42.637: INFO: stderr: "" Jan 22 06:51:42.637: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:51:44.637: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:48.298: INFO: stderr: "" Jan 22 06:51:48.298: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:51:50.298: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:53.468: INFO: stderr: "" Jan 22 06:51:53.468: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:51:55.469: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-5703 exec restored-pvc-tester-xmbln --namespace=snapshotting-5703 -- powershell /c type /mnt/test/data' Jan 22 06:51:58.885: INFO: stderr: "" Jan 22 06:51:58.885: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:52:00.885: FAIL: Unexpected error: <*errors.errorString | 0xc002a8e030>: { s: "Failed to find \"hello from snapshotting-5703 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-5703 namespace", last result: "���������������������������������������� " occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.5.2() /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268 +0x1254 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0014d5380) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc0014d5380) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc0014d5380, 0x4ff25a8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] volume snapshot controller /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:179 Jan 22 06:52:01.273: INFO: Pod restored-pvc-tester-xmbln has the following logs: Jan 22 06:52:01.273: INFO: Deleting pod "restored-pvc-tester-xmbln" in namespace "snapshotting-5703" Jan 22 06:52:01.319: INFO: Wait up to 5m0s for pod "restored-pvc-tester-xmbln" to be fully deleted Jan 22 06:52:35.404: INFO: deleting claim "snapshotting-5703"/"pvc-thfp2" Jan 22 06:52:35.450: INFO: deleting snapshot "snapshotting-5703"/"snapshot-pw49p" Jan 22 06:52:35.508: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-85c3ddb3-46e8-489b-82ea-1ba338f9dd95 creationTime:2021-01-22T06:47:25Z readyToUse:true restoreSize:5Gi] Jan 22 06:52:35.508: INFO: snapshotContentName snapcontent-85c3ddb3-46e8-489b-82ea-1ba338f9dd95 Jan 22 06:52:35.606: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-85c3ddb3-46e8-489b-82ea-1ba338f9dd95 to be deleted Jan 22 06:52:35.651: INFO: volumesnapshotcontents snapcontent-85c3ddb3-46e8-489b-82ea-1ba338f9dd95 has been found and is not deleted Jan 22 06:52:37.694: INFO: volumesnapshotcontents snapcontent-85c3ddb3-46e8-489b-82ea-1ba338f9dd95 has been found and is not deleted Jan 22 06:52:39.804: INFO: volumesnapshotcontents snapcontent-85c3ddb3-46e8-489b-82ea-1ba338f9dd95 has been found and is not deleted Jan 22 06:52:41.847: INFO: volumesnapshotcontents snapcontent-85c3ddb3-46e8-489b-82ea-1ba338f9dd95 has been found and is not deleted Jan 22 06:52:43.889: INFO: volumesnapshotcontents snapcontent-85c3ddb3-46e8-489b-82ea-1ba338f9dd95 is not found and has been deleted Jan 22 06:52:43.889: INFO: WaitUntil finished successfully after 8.283521558s Jan 22 06:52:43.890: INFO: deleting snapshot content "snapcontent-85c3ddb3-46e8-489b-82ea-1ba338f9dd95" Jan 22 06:52:43.931: INFO: deleting snapshot class "snapshotting-5703-vscw9qdf" Jan 22 06:52:43.985: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-5703-vscw9qdf to be deleted Jan 22 06:52:44.027: INFO: volumesnapshotclasses snapshotting-5703-vscw9qdf is not found and has been deleted Jan 22 06:52:44.027: INFO: WaitUntil finished successfully after 42.117382ms �[1mSTEP�[0m: Deleting pvc Jan 22 06:52:44.112: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windowszwvcw" Jan 22 06:52:44.156: INFO: Waiting up to 5m0s for PersistentVolume pvc-76949ac7-6694-492c-8b08-ccc1597d98f3 to get deleted Jan 22 06:52:44.202: INFO: PersistentVolume pvc-76949ac7-6694-492c-8b08-ccc1597d98f3 found and phase=Released (45.819357ms) Jan 22 06:52:49.244: INFO: PersistentVolume pvc-76949ac7-6694-492c-8b08-ccc1597d98f3 was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-5703". �[1mSTEP�[0m: Found 26 events. Jan 22 06:52:49.333: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-data-tester-dvhb5: { } Scheduled: Successfully assigned snapshotting-5703/pvc-snapshottable-data-tester-dvhb5 to e2e-eefa8d959e-9cdc3-windows-node-group-9zhd Jan 22 06:52:49.333: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-tester-t264g: { } Scheduled: Successfully assigned snapshotting-5703/pvc-snapshottable-tester-t264g to e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:52:49.333: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for restored-pvc-tester-xmbln: { } Scheduled: Successfully assigned snapshotting-5703/restored-pvc-tester-xmbln to e2e-eefa8d959e-9cdc3-windows-node-group-9zhd Jan 22 06:52:49.333: INFO: At 2021-01-22 06:46:04 +0000 UTC - event for csi-gcepd-sc-windowszwvcw: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 22 06:52:49.333: INFO: At 2021-01-22 06:46:04 +0000 UTC - event for csi-gcepd-sc-windowszwvcw: {pd.csi.storage.gke.io_e2e-eefa8d959e-9cdc3-minion-group-kvtg_cc55383e-bc23-4588-af9a-6af128d242d7 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-5703/csi-gcepd-sc-windowszwvcw" Jan 22 06:52:49.333: INFO: At 2021-01-22 06:46:04 +0000 UTC - event for csi-gcepd-sc-windowszwvcw: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 22 06:52:49.333: INFO: At 2021-01-22 06:46:08 +0000 UTC - event for csi-gcepd-sc-windowszwvcw: {pd.csi.storage.gke.io_e2e-eefa8d959e-9cdc3-minion-group-kvtg_cc55383e-bc23-4588-af9a-6af128d242d7 } ProvisioningSucceeded: Successfully provisioned volume pvc-76949ac7-6694-492c-8b08-ccc1597d98f3 Jan 22 06:52:49.333: INFO: At 2021-01-22 06:46:20 +0000 UTC - event for pvc-snapshottable-tester-t264g: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-76949ac7-6694-492c-8b08-ccc1597d98f3" Jan 22 06:52:49.333: INFO: At 2021-01-22 06:47:11 +0000 UTC - event for pvc-snapshottable-tester-t264g: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 06:52:49.333: INFO: At 2021-01-22 06:47:12 +0000 UTC - event for pvc-snapshottable-tester-t264g: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Created: Created container volume-tester Jan 22 06:52:49.333: INFO: At 2021-01-22 06:47:13 +0000 UTC - event for pvc-snapshottable-tester-t264g: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Started: Started container volume-tester Jan 22 06:52:49.333: INFO: At 2021-01-22 06:47:24 +0000 UTC - event for snapshot-pw49p: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-5703/snapshot-pw49p to be created by the CSI driver. Jan 22 06:52:49.333: INFO: At 2021-01-22 06:47:43 +0000 UTC - event for pvc-snapshottable-data-tester-dvhb5: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-76949ac7-6694-492c-8b08-ccc1597d98f3" Volume is already exclusively attached to one node and can't be attached to another Jan 22 06:52:49.333: INFO: At 2021-01-22 06:47:59 +0000 UTC - event for pvc-snapshottable-data-tester-dvhb5: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-76949ac7-6694-492c-8b08-ccc1597d98f3" Jan 22 06:52:49.333: INFO: At 2021-01-22 06:48:54 +0000 UTC - event for pvc-snapshottable-data-tester-dvhb5: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-9zhd} Created: Created container volume-tester Jan 22 06:52:49.333: INFO: At 2021-01-22 06:48:54 +0000 UTC - event for pvc-snapshottable-data-tester-dvhb5: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-9zhd} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 06:52:49.333: INFO: At 2021-01-22 06:48:56 +0000 UTC - event for pvc-snapshottable-data-tester-dvhb5: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-9zhd} Started: Started container volume-tester Jan 22 06:52:49.333: INFO: At 2021-01-22 06:49:15 +0000 UTC - event for pvc-thfp2: {pd.csi.storage.gke.io_e2e-eefa8d959e-9cdc3-minion-group-kvtg_cc55383e-bc23-4588-af9a-6af128d242d7 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-5703/pvc-thfp2" Jan 22 06:52:49.333: INFO: At 2021-01-22 06:49:15 +0000 UTC - event for pvc-thfp2: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 22 06:52:49.333: INFO: At 2021-01-22 06:49:15 +0000 UTC - event for pvc-thfp2: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 22 06:52:49.333: INFO: At 2021-01-22 06:49:37 +0000 UTC - event for pvc-thfp2: {pd.csi.storage.gke.io_e2e-eefa8d959e-9cdc3-minion-group-kvtg_cc55383e-bc23-4588-af9a-6af128d242d7 } ProvisioningSucceeded: Successfully provisioned volume pvc-6f4d1823-6dbd-4f50-8499-16c31a4d58b3 Jan 22 06:52:49.333: INFO: At 2021-01-22 06:49:46 +0000 UTC - event for restored-pvc-tester-xmbln: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-6f4d1823-6dbd-4f50-8499-16c31a4d58b3" Jan 22 06:52:49.333: INFO: At 2021-01-22 06:50:47 +0000 UTC - event for restored-pvc-tester-xmbln: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-9zhd} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 06:52:49.333: INFO: At 2021-01-22 06:50:47 +0000 UTC - event for restored-pvc-tester-xmbln: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-9zhd} Created: Created container volume-tester Jan 22 06:52:49.333: INFO: At 2021-01-22 06:50:50 +0000 UTC - event for restored-pvc-tester-xmbln: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-9zhd} Started: Started container volume-tester Jan 22 06:52:49.333: INFO: At 2021-01-22 06:52:02 +0000 UTC - event for restored-pvc-tester-xmbln: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-9zhd} Killing: Stopping container volume-tester Jan 22 06:52:49.374: INFO: POD NODE PHASE GRACE CONDITIONS Jan 22 06:52:49.374: INFO: Jan 22 06:52:49.425: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-master Jan 22 06:52:49.467: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-master 80aa5118-1a1d-43f8-97a9-84d9ffbf3002 8749 0 2021-01-22 06:09:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 06:09:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2021-01-22 06:37:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 06:41:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3866853376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3604709376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:09:24 +0000 UTC,LastTransitionTime:2021-01-22 06:09:24 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.193.2,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-master.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-master.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:17a0e186650a97c2461075fbde687797,SystemUUID:17a0e186-650a-97c2-4610-75fbde687797,BootID:773ab65b-b4c0-4828-86b8-fd5a140c9def,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.21.0-alpha.1.250_88c652c154c1e3],SizeBytes:123005230,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.21.0-alpha.1.250_88c652c154c1e3],SizeBytes:117520714,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:70314596,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.21.0-alpha.1.250_88c652c154c1e3],SizeBytes:47716661,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 06:52:49.468: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-master Jan 22 06:52:49.512: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-master Jan 22 06:52:49.571: INFO: etcd-server-events-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:03 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:49.571: INFO: Container etcd-container ready: true, restart count 0 Jan 22 06:52:49.571: INFO: etcd-server-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:13 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:49.571: INFO: Container etcd-container ready: true, restart count 0 Jan 22 06:52:49.571: INFO: kube-apiserver-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:23 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:49.571: INFO: Container kube-apiserver ready: true, restart count 0 Jan 22 06:52:49.571: INFO: l7-lb-controller-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:09:09 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:49.571: INFO: Container l7-lb-controller ready: true, restart count 0 Jan 22 06:52:49.571: INFO: metadata-proxy-v0.1-72drn started at 2021-01-22 06:09:42 +0000 UTC (0+2 container statuses recorded) Jan 22 06:52:49.571: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 06:52:49.571: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 22 06:52:49.571: INFO: kube-controller-manager-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:33 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:49.571: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 22 06:52:49.571: INFO: kube-scheduler-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:43 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:49.571: INFO: Container kube-scheduler ready: true, restart count 0 Jan 22 06:52:49.571: INFO: kube-addon-manager-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:49.571: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 22 06:52:49.571: INFO: csi-gce-pd-node-s2j9j started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:52:49.571: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:52:49.571: INFO: Container gce-pd-driver ready: true, restart count 0 W0122 06:52:49.631074 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:52:49.960: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-master Jan 22 06:52:49.961: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-minion-group-kvtg Jan 22 06:52:50.004: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-minion-group-kvtg b6dd2d66-53b4-4ef3-9c96-3c75e822f017 8751 0 2021-01-22 06:09:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-minion-group-kvtg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-minion-group-kvtg"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 06:09:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-22 06:09:35 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-22 06:37:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 06:41:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-minion-group-kvtg,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-22 06:49:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-22 06:49:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-22 06:49:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-22 06:49:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-22 06:49:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-22 06:49:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-22 06:49:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:09:30 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.6,},NodeAddress{Type:ExternalIP,Address:34.82.120.217,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-minion-group-kvtg.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-minion-group-kvtg.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ca28c70b44a8b1feddc8608aefea1d37,SystemUUID:ca28c70b-44a8-b1fe-ddc8-608aefea1d37,BootID:78efbb40-4d09-4a7d-b071-7f6aca00968d,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.250_88c652c154c1e3],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:70314596,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:bec571992d40203edcd056ac0b0d97003887ee5e4be144c41932d18639673b03 k8s.gcr.io/sig-storage/csi-provisioner:v2.0.4],SizeBytes:20428748,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:e5ce22ddc2a6fbc9b5729dbcfaf1159c4b0d48dad62ddd1b93503c1348e4a406 k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.1],SizeBytes:19498883,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:ca160717df7f6b7964c936faf608b914f2277363e6d708ea2e2dbbf2c5f56a83 k8s.gcr.io/sig-storage/csi-resizer:v1.0.1],SizeBytes:19463877,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:7495d30800fb3ef22f3dc6d5fe9a0a6ec40ba32a2bdc0cf5e7fcaa507adc921e k8s.gcr.io/sig-storage/csi-attacher:v3.0.1],SizeBytes:19460260,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 06:52:50.004: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-minion-group-kvtg Jan 22 06:52:50.048: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-minion-group-kvtg Jan 22 06:52:50.113: INFO: metadata-proxy-v0.1-zpr79 started at 2021-01-22 06:09:30 +0000 UTC (0+2 container statuses recorded) Jan 22 06:52:50.113: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 06:52:50.113: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 22 06:52:50.113: INFO: coredns-6954c77b9b-dsgss started at 2021-01-22 06:09:43 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:50.113: INFO: Container coredns ready: true, restart count 0 Jan 22 06:52:50.113: INFO: kube-dns-autoscaler-76478fcf46-6nmmv started at 2021-01-22 06:09:46 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:50.113: INFO: Container autoscaler ready: true, restart count 0 Jan 22 06:52:50.113: INFO: csi-gce-pd-controller-56b4c5f5d-tglnh started at 2021-01-22 06:37:05 +0000 UTC (0+5 container statuses recorded) Jan 22 06:52:50.113: INFO: Container csi-attacher ready: true, restart count 0 Jan 22 06:52:50.113: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 06:52:50.113: INFO: Container csi-resizer ready: true, restart count 0 Jan 22 06:52:50.113: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 22 06:52:50.113: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 06:52:50.113: INFO: metrics-server-v0.3.6-8b98f98c9-wnr9f started at 2021-01-22 06:10:15 +0000 UTC (0+2 container statuses recorded) Jan 22 06:52:50.113: INFO: Container metrics-server ready: true, restart count 0 Jan 22 06:52:50.113: INFO: Container metrics-server-nanny ready: true, restart count 0 Jan 22 06:52:50.113: INFO: csi-gce-pd-node-q7v2v started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:52:50.113: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:52:50.113: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 06:52:50.113: INFO: kube-proxy-e2e-eefa8d959e-9cdc3-minion-group-kvtg started at 2021-01-22 06:09:30 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:50.113: INFO: Container kube-proxy ready: true, restart count 0 W0122 06:52:50.167289 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:52:50.415: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-minion-group-kvtg Jan 22 06:52:50.415: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-minion-group-qw6h Jan 22 06:52:50.458: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-minion-group-qw6h 7d8bdad8-f155-4939-acd3-b095371d9a43 8750 0 2021-01-22 06:09:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-minion-group-qw6h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-minion-group-qw6h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 06:09:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.5.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-22 06:09:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-22 06:37:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 06:41:32 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.5.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-minion-group-qw6h,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.5.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-22 06:49:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-22 06:49:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-22 06:49:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-22 06:49:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-22 06:49:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-22 06:49:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-22 06:49:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:09:30 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:52:38 +0000 UTC,LastTransitionTime:2021-01-22 06:09:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.7,},NodeAddress{Type:ExternalIP,Address:34.82.85.149,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-minion-group-qw6h.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-minion-group-qw6h.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a01d150196c5cf134c7cc21e439a9223,SystemUUID:a01d1501-96c5-cf13-4c7c-c21e439a9223,BootID:996d1268-4a57-4ff9-956b-07f1a1f1ba0b,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.250_88c652c154c1e3],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:70314596,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:a494ff6ec10e05a454458fbf44247d93c9b3a0d983a00b538e442f353b7030c8 k8s.gcr.io/sig-storage/snapshot-controller:v3.0.2],SizeBytes:17461280,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 06:52:50.458: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-minion-group-qw6h Jan 22 06:52:50.509: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-minion-group-qw6h Jan 22 06:52:50.587: INFO: csi-gce-pd-node-chvc2 started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:52:50.587: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:52:50.587: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 06:52:50.587: INFO: coredns-6954c77b9b-cc9f4 started at 2021-01-22 06:09:49 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:50.587: INFO: Container coredns ready: true, restart count 0 Jan 22 06:52:50.587: INFO: kube-proxy-e2e-eefa8d959e-9cdc3-minion-group-qw6h started at 2021-01-22 06:09:30 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:50.587: INFO: Container kube-proxy ready: true, restart count 0 Jan 22 06:52:50.587: INFO: metadata-proxy-v0.1-5blbg started at 2021-01-22 06:09:30 +0000 UTC (0+2 container statuses recorded) Jan 22 06:52:50.587: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 06:52:50.587: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 22 06:52:50.587: INFO: volume-snapshot-controller-0 started at 2021-01-22 06:09:43 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:50.587: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jan 22 06:52:50.587: INFO: l7-default-backend-6dd8477499-kg5fc started at 2021-01-22 06:09:44 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:50.587: INFO: Container default-http-backend ready: true, restart count 0 W0122 06:52:50.658343 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:52:50.868: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-minion-group-qw6h Jan 22 06:52:50.868: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-windows-node-group-23gm Jan 22 06:52:50.958: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-windows-node-group-23gm a80ad4eb-6e61-432d-a9c9-73422b201cf6 8865 0 2021-01-22 06:12:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-windows-node-group-23gm kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-windows-node-group-23gm"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-22 06:52:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-22 06:52:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-windows-node-group-23gm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:12:01 +0000 UTC,LastTransitionTime:2021-01-22 06:12:01 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:50 +0000 UTC,LastTransitionTime:2021-01-22 06:12:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:50 +0000 UTC,LastTransitionTime:2021-01-22 06:12:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:50 +0000 UTC,LastTransitionTime:2021-01-22 06:12:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:52:50 +0000 UTC,LastTransitionTime:2021-01-22 06:12:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.203.140.229,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-windows-node-group-23gm.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-windows-node-group-23gm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-eefa8d959e-9cdc3-windows-node-group-23gm,SystemUUID:B5B55A0B-06E2-16DD-4FBE-5E4293EDBC5E,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-365c50b6-345c-4319-9b20-3bd2d287cd12 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-621e7476-b456-43b9-9715-bf7d8c813a68 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-8fc7a53d-cb5e-4efc-89c2-6fc36e0f3055],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-365c50b6-345c-4319-9b20-3bd2d287cd12,DevicePath:,},},Config:nil,},} Jan 22 06:52:50.958: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-windows-node-group-23gm Jan 22 06:52:51.029: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-windows-node-group-23gm Jan 22 06:52:51.139: INFO: csi-gce-pd-node-win-sxkkw started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:52:51.139: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:52:51.139: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 06:52:51.139: INFO: pvc-snapshottable-tester-lzpnn started at 2021-01-22 06:52:32 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:51.139: INFO: Container volume-tester ready: false, restart count 0 Jan 22 06:52:51.139: INFO: pod-subpath-test-dynamicpv-gnpx started at 2021-01-22 06:52:43 +0000 UTC (2+1 container statuses recorded) Jan 22 06:52:51.139: INFO: Init container init-volume-dynamicpv-gnpx ready: false, restart count 0 Jan 22 06:52:51.139: INFO: Init container test-init-volume-dynamicpv-gnpx ready: false, restart count 0 Jan 22 06:52:51.139: INFO: Container test-container-subpath-dynamicpv-gnpx ready: false, restart count 0 Jan 22 06:52:51.139: INFO: restored-pvc-tester-bwtq2 started at 2021-01-22 06:52:44 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:51.139: INFO: Container volume-tester ready: false, restart count 0 W0122 06:52:51.191667 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:52:51.816: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-windows-node-group-23gm Jan 22 06:52:51.816: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-windows-node-group-9zhd Jan 22 06:52:51.859: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-windows-node-group-9zhd b05f7098-725c-4874-9d4a-b394bb855f48 8846 0 2021-01-22 06:11:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-windows-node-group-9zhd kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-windows-node-group-9zhd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-22 06:42:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-22 06:47:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-windows-node-group-9zhd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:11:51 +0000 UTC,LastTransitionTime:2021-01-22 06:11:51 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:45 +0000 UTC,LastTransitionTime:2021-01-22 06:11:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:45 +0000 UTC,LastTransitionTime:2021-01-22 06:11:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:45 +0000 UTC,LastTransitionTime:2021-01-22 06:11:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:52:45 +0000 UTC,LastTransitionTime:2021-01-22 06:12:01 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.64.127,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-windows-node-group-9zhd.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-windows-node-group-9zhd,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-eefa8d959e-9cdc3-windows-node-group-9zhd,SystemUUID:2DA68E54-6BA1-E4AE-B916-015B98FE74EC,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-606054f5-2103-4aab-bafc-376f05e2b1e5 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-6f4d1823-6dbd-4f50-8499-16c31a4d58b3 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-91e8e9b1-6a53-46cd-b4d2-81b10fc96841],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-606054f5-2103-4aab-bafc-376f05e2b1e5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-91e8e9b1-6a53-46cd-b4d2-81b10fc96841,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-6f4d1823-6dbd-4f50-8499-16c31a4d58b3,DevicePath:,},},Config:nil,},} Jan 22 06:52:51.859: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-windows-node-group-9zhd Jan 22 06:52:51.903: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-windows-node-group-9zhd Jan 22 06:52:52.025: INFO: csi-gce-pd-node-win-dlnrr started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:52:52.025: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:52:52.025: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 06:52:52.025: INFO: pod-subpath-test-dynamicpv-t6wv started at 2021-01-22 06:51:27 +0000 UTC (1+1 container statuses recorded) Jan 22 06:52:52.025: INFO: Init container init-volume-dynamicpv-t6wv ready: false, restart count 0 Jan 22 06:52:52.025: INFO: Container test-container-subpath-dynamicpv-t6wv ready: false, restart count 0 Jan 22 06:52:52.025: INFO: external-injector started at 2021-01-22 06:52:38 +0000 UTC (0+1 container statuses recorded) Jan 22 06:52:52.025: INFO: Container external-injector ready: false, restart count 0 W0122 06:52:52.075796 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:52:53.519: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-windows-node-group-9zhd Jan 22 06:52:53.519: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:52:53.563: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-windows-node-group-w85f 5e0bb3ac-2ba4-4b12-8792-fc676012dc0e 8605 0 2021-01-22 06:11:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-windows-node-group-w85f kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-windows-node-group-w85f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-22 06:47:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-windows-node-group-w85f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:11:58 +0000 UTC,LastTransitionTime:2021-01-22 06:11:58 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:18 +0000 UTC,LastTransitionTime:2021-01-22 06:11:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:18 +0000 UTC,LastTransitionTime:2021-01-22 06:11:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:52:18 +0000 UTC,LastTransitionTime:2021-01-22 06:11:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:52:18 +0000 UTC,LastTransitionTime:2021-01-22 06:12:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.105.96.73,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-windows-node-group-w85f.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-windows-node-group-w85f,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-eefa8d959e-9cdc3-windows-node-group-w85f,SystemUUID:294CB3B9-32A9-24A5-3F1B-36AF69CE4C9D,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-eae4596d-d943-405b-9bb8-9a1413b31428],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-eae4596d-d943-405b-9bb8-9a1413b31428,DevicePath:,},},Config:nil,},} Jan 22 06:52:53.563: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:52:53.607: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:52:53.708: INFO: csi-gce-pd-node-win-9gdwx started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:52:53.708: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:52:53.708: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 06:52:53.708: INFO: pod-subpath-test-dynamicpv-thlm started at 2021-01-22 06:49:37 +0000 UTC (1+2 container statuses recorded) Jan 22 06:52:53.708: INFO: Init container init-volume-dynamicpv-thlm ready: true, restart count 0 Jan 22 06:52:53.708: INFO: Container test-container-subpath-dynamicpv-thlm ready: true, restart count 2 Jan 22 06:52:53.708: INFO: Container test-container-volume-dynamicpv-thlm ready: true, restart count 0 W0122 06:52:53.759642 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:52:54.195: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:52:54.195: INFO: Waiting up to 3m0s for all (but 3) nodes to be ready �[1mSTEP�[0m: Destroying namespace "snapshotting-5703" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=External\sStorage\s\[Driver\:\scsi\-gcepd\-sc\-windows\]\s\[Testpattern\:\sPre\-provisioned\sSnapshot\s\(delete\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion$'
/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 Jan 22 06:58:45.784: Unexpected error: <*errors.errorString | 0xc002a8ec10>: { s: "Failed to find \"hello from snapshotting-8513 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-8513 namespace", last result: "���������������������������������������� " occurred /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268from junit_pdcsi.xml
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 22 06:54:30.034: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] volume snapshot controller /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:176 Jan 22 06:54:30.226: INFO: Creating resource for dynamic PV Jan 22 06:54:30.226: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(csi-gcepd-sc-windows) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-8513-e2e-sclnc87 �[1mSTEP�[0m: creating a claim Jan 22 06:54:30.266: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: starting a pod to use the claim Jan 22 06:54:30.394: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-sghql" in namespace "snapshotting-8513" to be "Succeeded or Failed" Jan 22 06:54:30.437: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 42.861843ms Jan 22 06:54:32.476: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 2.081513063s Jan 22 06:54:34.519: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 4.125213354s Jan 22 06:54:36.558: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 6.164003782s Jan 22 06:54:38.597: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 8.203071993s Jan 22 06:54:40.637: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 10.243232712s Jan 22 06:54:42.677: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 12.282501011s Jan 22 06:54:44.716: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 14.321941146s Jan 22 06:54:46.755: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 16.361080918s Jan 22 06:54:48.795: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 18.400989428s Jan 22 06:54:50.834: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 20.43966929s Jan 22 06:54:52.873: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 22.478886091s Jan 22 06:54:54.915: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 24.520939272s Jan 22 06:54:56.964: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 26.570271459s Jan 22 06:54:59.004: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 28.609610524s Jan 22 06:55:01.050: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 30.656012874s Jan 22 06:55:03.090: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 32.696071002s Jan 22 06:55:05.130: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 34.73561792s Jan 22 06:55:07.171: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 36.776420229s Jan 22 06:55:09.211: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 38.816713701s Jan 22 06:55:11.250: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 40.856015397s Jan 22 06:55:13.290: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 42.895845096s Jan 22 06:55:15.329: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 44.935143636s Jan 22 06:55:17.368: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 46.974282006s Jan 22 06:55:19.413: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 49.018554391s Jan 22 06:55:21.454: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 51.059814955s Jan 22 06:55:23.494: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 53.099570507s Jan 22 06:55:25.533: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 55.139327574s Jan 22 06:55:27.573: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 57.178554835s Jan 22 06:55:29.612: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 59.217582133s Jan 22 06:55:31.657: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.262719602s Jan 22 06:55:33.696: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.301768575s Jan 22 06:55:35.744: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.350352257s Jan 22 06:55:37.785: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.39107342s Jan 22 06:55:39.824: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.43009418s Jan 22 06:55:41.863: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.46930241s Jan 22 06:55:43.903: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Running", Reason="", readiness=true. Elapsed: 1m13.508483584s Jan 22 06:55:45.942: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Running", Reason="", readiness=true. Elapsed: 1m15.547855417s Jan 22 06:55:47.983: INFO: Pod "pvc-snapshottable-tester-sghql": Phase="Succeeded", Reason="", readiness=false. Elapsed: 1m17.588674353s �[1mSTEP�[0m: Saw pod success Jan 22 06:55:47.983: INFO: Pod "pvc-snapshottable-tester-sghql" satisfied condition "Succeeded or Failed" Jan 22 06:55:48.188: INFO: Pod pvc-snapshottable-tester-sghql has the following logs: Jan 22 06:55:48.188: INFO: Deleting pod "pvc-snapshottable-tester-sghql" in namespace "snapshotting-8513" Jan 22 06:55:48.234: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-sghql" to be fully deleted Jan 22 06:55:48.273: INFO: Waiting up to 5m0s for PersistentVolumeClaims [csi-gcepd-sc-windowszl2bv] to have phase Bound Jan 22 06:55:48.311: INFO: PersistentVolumeClaim csi-gcepd-sc-windowszl2bv found and phase=Bound (38.535335ms) �[1mSTEP�[0m: checking the claim �[1mSTEP�[0m: checking the PV [BeforeEach] /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:190 �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jan 22 06:55:48.515: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-kzdhk to become ready Jan 22 06:55:48.559: INFO: VolumeSnapshot snapshot-kzdhk found but is not ready. Jan 22 06:55:50.602: INFO: VolumeSnapshot snapshot-kzdhk found but is not ready. Jan 22 06:55:52.642: INFO: VolumeSnapshot snapshot-kzdhk found but is not ready. Jan 22 06:55:54.681: INFO: VolumeSnapshot snapshot-kzdhk found but is not ready. Jan 22 06:55:56.721: INFO: VolumeSnapshot snapshot-kzdhk found but is not ready. Jan 22 06:55:58.761: INFO: VolumeSnapshot snapshot-kzdhk found but is not ready. Jan 22 06:56:00.801: INFO: VolumeSnapshot snapshot-kzdhk found but is not ready. Jan 22 06:56:02.841: INFO: VolumeSnapshot snapshot-kzdhk found but is not ready. Jan 22 06:56:04.880: INFO: VolumeSnapshot snapshot-kzdhk found but is not ready. Jan 22 06:56:06.920: INFO: VolumeSnapshot snapshot-kzdhk found and is ready Jan 22 06:56:06.920: INFO: WaitUntil finished successfully after 18.404794625s Jan 22 06:56:06.962: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-1115ca5f-ad5a-445d-8150-f7f6ce848916 creationTime:2021-01-22T06:55:49Z readyToUse:true restoreSize:5Gi] Jan 22 06:56:06.962: INFO: snapshotContentName snapcontent-1115ca5f-ad5a-445d-8150-f7f6ce848916 �[1mSTEP�[0m: updating the snapshot content deletion policy to retain �[1mSTEP�[0m: recording the volume handle and snapshotHandle Jan 22 06:56:07.051: INFO: Recording snapshot handle: projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/global/snapshots/snapshot-1115ca5f-ad5a-445d-8150-f7f6ce848916 �[1mSTEP�[0m: deleting the snapshot and snapshot content �[1mSTEP�[0m: checking the Snapshot has been deleted Jan 22 06:56:07.096: INFO: Waiting up to 5m0s for volumesnapshots snapshotting-8513 to be deleted Jan 22 06:56:07.135: INFO: volumesnapshots snapshotting-8513 is not found in namespace snapshot-kzdhk and has been deleted Jan 22 06:56:07.135: INFO: WaitUntil finished successfully after 39.148236ms �[1mSTEP�[0m: checking the Snapshot content has been deleted Jan 22 06:56:07.186: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-1115ca5f-ad5a-445d-8150-f7f6ce848916 to be deleted Jan 22 06:56:07.226: INFO: volumesnapshotcontents snapcontent-1115ca5f-ad5a-445d-8150-f7f6ce848916 is not found and has been deleted Jan 22 06:56:07.226: INFO: WaitUntil finished successfully after 39.852ms �[1mSTEP�[0m: creating a snapshot content with the snapshot handle �[1mSTEP�[0m: creating a snapshot with that snapshot content Jan 22 06:56:07.312: INFO: Waiting up to 5m0s for VolumeSnapshot pre-provisioned-snapshot-1736eda5-eb06-4468-833e-a837a55ae6b2 to become ready Jan 22 06:56:07.352: INFO: VolumeSnapshot pre-provisioned-snapshot-1736eda5-eb06-4468-833e-a837a55ae6b2 found but is not ready. Jan 22 06:56:09.391: INFO: VolumeSnapshot pre-provisioned-snapshot-1736eda5-eb06-4468-833e-a837a55ae6b2 found and is ready Jan 22 06:56:09.391: INFO: WaitUntil finished successfully after 2.078549726s �[1mSTEP�[0m: getting the snapshot and snapshot content [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:200 �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: Modifying source data test �[1mSTEP�[0m: modifying the data in the source PVC Jan 22 06:56:09.605: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-dkzvv" in namespace "snapshotting-8513" to be "Succeeded or Failed" Jan 22 06:56:09.644: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 38.549781ms Jan 22 06:56:11.683: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.078229398s Jan 22 06:56:13.723: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.118053194s Jan 22 06:56:15.762: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.157281953s Jan 22 06:56:17.801: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.196177301s Jan 22 06:56:19.841: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.235418145s Jan 22 06:56:21.880: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 12.274612405s Jan 22 06:56:23.919: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 14.314112231s Jan 22 06:56:25.958: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 16.353230743s Jan 22 06:56:27.997: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 18.392331639s Jan 22 06:56:30.036: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 20.430959287s Jan 22 06:56:32.089: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 22.484301026s Jan 22 06:56:34.129: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 24.523644202s Jan 22 06:56:36.169: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Pending", Reason="", readiness=false. Elapsed: 26.563771801s Jan 22 06:56:38.211: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Running", Reason="", readiness=true. Elapsed: 28.605888772s Jan 22 06:56:40.251: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Running", Reason="", readiness=true. Elapsed: 30.645545636s Jan 22 06:56:42.291: INFO: Pod "pvc-snapshottable-data-tester-dkzvv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 32.68569789s �[1mSTEP�[0m: Saw pod success Jan 22 06:56:42.291: INFO: Pod "pvc-snapshottable-data-tester-dkzvv" satisfied condition "Succeeded or Failed" Jan 22 06:56:42.340: INFO: Pod pvc-snapshottable-data-tester-dkzvv has the following logs: Jan 22 06:56:42.340: INFO: Deleting pod "pvc-snapshottable-data-tester-dkzvv" in namespace "snapshotting-8513" Jan 22 06:56:42.387: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-dkzvv" to be fully deleted �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the claim Jan 22 06:57:44.590: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:57:47.605: INFO: stderr: "" Jan 22 06:57:47.605: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:57:49.606: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:57:50.655: INFO: stderr: "" Jan 22 06:57:50.655: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:57:52.655: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:57:53.620: INFO: stderr: "" Jan 22 06:57:53.620: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:57:55.620: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:57:56.604: INFO: stderr: "" Jan 22 06:57:56.604: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:57:58.604: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:00.018: INFO: stderr: "" Jan 22 06:58:00.018: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:02.018: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:03.398: INFO: stderr: "" Jan 22 06:58:03.398: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:05.398: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:06.416: INFO: stderr: "" Jan 22 06:58:06.416: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:08.417: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:09.591: INFO: stderr: "" Jan 22 06:58:09.591: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:11.591: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:12.643: INFO: stderr: "" Jan 22 06:58:12.643: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:14.643: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:15.918: INFO: stderr: "" Jan 22 06:58:15.918: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:17.919: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:18.901: INFO: stderr: "" Jan 22 06:58:18.901: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:20.901: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:21.888: INFO: stderr: "" Jan 22 06:58:21.888: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:23.888: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:24.917: INFO: stderr: "" Jan 22 06:58:24.917: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:26.917: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:28.291: INFO: stderr: "" Jan 22 06:58:28.291: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:30.292: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:31.311: INFO: stderr: "" Jan 22 06:58:31.311: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:33.311: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:34.354: INFO: stderr: "" Jan 22 06:58:34.354: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:36.354: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:37.355: INFO: stderr: "" Jan 22 06:58:37.355: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:39.355: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:40.787: INFO: stderr: "" Jan 22 06:58:40.788: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:42.788: INFO: Running '/tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/bin/kubectl --server=https://35.233.193.2 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-8513 exec restored-pvc-tester-42z4m --namespace=snapshotting-8513 -- powershell /c type /mnt/test/data' Jan 22 06:58:43.783: INFO: stderr: "" Jan 22 06:58:43.783: INFO: stdout: "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n" Jan 22 06:58:45.784: FAIL: Unexpected error: <*errors.errorString | 0xc002a8ec10>: { s: "Failed to find \"hello from snapshotting-8513 namespace\", last result: \"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r\n\"", } Failed to find "hello from snapshotting-8513 namespace", last result: "���������������������������������������� " occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.5.2() /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:268 +0x1254 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0014d5380) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc0014d5380) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc0014d5380, 0x4ff25a8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] volume snapshot controller /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/snapshottable.go:179 Jan 22 06:58:45.844: INFO: Pod restored-pvc-tester-42z4m has the following logs: Jan 22 06:58:45.844: INFO: Deleting pod "restored-pvc-tester-42z4m" in namespace "snapshotting-8513" Jan 22 06:58:45.885: INFO: Wait up to 5m0s for pod "restored-pvc-tester-42z4m" to be fully deleted Jan 22 06:58:49.964: INFO: deleting claim "snapshotting-8513"/"pvc-nxppm" Jan 22 06:58:50.005: INFO: deleting snapshot "snapshotting-8513"/"pre-provisioned-snapshot-1736eda5-eb06-4468-833e-a837a55ae6b2" Jan 22 06:58:50.054: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:pre-provisioned-snapcontent-1736eda5-eb06-4468-833e-a837a55ae6b2 creationTime:2021-01-22T06:55:49Z readyToUse:true restoreSize:5Gi] Jan 22 06:58:50.054: INFO: snapshotContentName pre-provisioned-snapcontent-1736eda5-eb06-4468-833e-a837a55ae6b2 Jan 22 06:58:50.137: INFO: Waiting up to 5m0s for volumesnapshotcontents pre-provisioned-snapcontent-1736eda5-eb06-4468-833e-a837a55ae6b2 to be deleted Jan 22 06:58:50.178: INFO: volumesnapshotcontents pre-provisioned-snapcontent-1736eda5-eb06-4468-833e-a837a55ae6b2 has been found and is not deleted Jan 22 06:58:52.222: INFO: volumesnapshotcontents pre-provisioned-snapcontent-1736eda5-eb06-4468-833e-a837a55ae6b2 has been found and is not deleted Jan 22 06:58:54.261: INFO: volumesnapshotcontents pre-provisioned-snapcontent-1736eda5-eb06-4468-833e-a837a55ae6b2 is not found and has been deleted Jan 22 06:58:54.261: INFO: WaitUntil finished successfully after 4.124117247s Jan 22 06:58:54.261: INFO: deleting snapshot content "pre-provisioned-snapcontent-1736eda5-eb06-4468-833e-a837a55ae6b2" Jan 22 06:58:54.300: INFO: deleting snapshot class "snapshotting-8513-vsc499wt" Jan 22 06:58:54.342: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-8513-vsc499wt to be deleted Jan 22 06:58:54.381: INFO: volumesnapshotclasses snapshotting-8513-vsc499wt is not found and has been deleted Jan 22 06:58:54.381: INFO: WaitUntil finished successfully after 38.815634ms �[1mSTEP�[0m: Deleting pvc Jan 22 06:58:54.458: INFO: Deleting PersistentVolumeClaim "csi-gcepd-sc-windowszl2bv" Jan 22 06:58:54.498: INFO: Waiting up to 5m0s for PersistentVolume pvc-2df5ebf6-b045-4308-b029-bf3e9e3b8db7 to get deleted Jan 22 06:58:54.537: INFO: PersistentVolume pvc-2df5ebf6-b045-4308-b029-bf3e9e3b8db7 found and phase=Released (38.438735ms) Jan 22 06:58:59.576: INFO: PersistentVolume pvc-2df5ebf6-b045-4308-b029-bf3e9e3b8db7 was removed �[1mSTEP�[0m: Deleting sc [AfterEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] /tmp/gcp-pd-driver-tmp018638829/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-8513". �[1mSTEP�[0m: Found 24 events. Jan 22 06:58:59.657: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-data-tester-dkzvv: { } Scheduled: Successfully assigned snapshotting-8513/pvc-snapshottable-data-tester-dkzvv to e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:58:59.657: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pvc-snapshottable-tester-sghql: { } Scheduled: Successfully assigned snapshotting-8513/pvc-snapshottable-tester-sghql to e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:58:59.657: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for restored-pvc-tester-42z4m: { } Scheduled: Successfully assigned snapshotting-8513/restored-pvc-tester-42z4m to e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:58:59.657: INFO: At 2021-01-22 06:54:30 +0000 UTC - event for csi-gcepd-sc-windowszl2bv: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 22 06:58:59.657: INFO: At 2021-01-22 06:54:30 +0000 UTC - event for csi-gcepd-sc-windowszl2bv: {pd.csi.storage.gke.io_e2e-eefa8d959e-9cdc3-minion-group-kvtg_cc55383e-bc23-4588-af9a-6af128d242d7 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-8513/csi-gcepd-sc-windowszl2bv" Jan 22 06:58:59.657: INFO: At 2021-01-22 06:54:30 +0000 UTC - event for csi-gcepd-sc-windowszl2bv: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 22 06:58:59.657: INFO: At 2021-01-22 06:54:34 +0000 UTC - event for csi-gcepd-sc-windowszl2bv: {pd.csi.storage.gke.io_e2e-eefa8d959e-9cdc3-minion-group-kvtg_cc55383e-bc23-4588-af9a-6af128d242d7 } ProvisioningSucceeded: Successfully provisioned volume pvc-2df5ebf6-b045-4308-b029-bf3e9e3b8db7 Jan 22 06:58:59.657: INFO: At 2021-01-22 06:54:46 +0000 UTC - event for pvc-snapshottable-tester-sghql: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-2df5ebf6-b045-4308-b029-bf3e9e3b8db7" Jan 22 06:58:59.657: INFO: At 2021-01-22 06:55:35 +0000 UTC - event for pvc-snapshottable-tester-sghql: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Created: Created container volume-tester Jan 22 06:58:59.657: INFO: At 2021-01-22 06:55:35 +0000 UTC - event for pvc-snapshottable-tester-sghql: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 06:58:59.657: INFO: At 2021-01-22 06:55:37 +0000 UTC - event for pvc-snapshottable-tester-sghql: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Started: Started container volume-tester Jan 22 06:58:59.657: INFO: At 2021-01-22 06:55:48 +0000 UTC - event for snapshot-kzdhk: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-8513/snapshot-kzdhk to be created by the CSI driver. Jan 22 06:58:59.657: INFO: At 2021-01-22 06:56:32 +0000 UTC - event for pvc-snapshottable-data-tester-dkzvv: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Created: Created container volume-tester Jan 22 06:58:59.657: INFO: At 2021-01-22 06:56:32 +0000 UTC - event for pvc-snapshottable-data-tester-dkzvv: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 06:58:59.657: INFO: At 2021-01-22 06:56:33 +0000 UTC - event for pvc-snapshottable-data-tester-dkzvv: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Started: Started container volume-tester Jan 22 06:58:59.657: INFO: At 2021-01-22 06:56:42 +0000 UTC - event for pvc-nxppm: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 22 06:58:59.657: INFO: At 2021-01-22 06:56:42 +0000 UTC - event for pvc-nxppm: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jan 22 06:58:59.657: INFO: At 2021-01-22 06:56:42 +0000 UTC - event for pvc-nxppm: {pd.csi.storage.gke.io_e2e-eefa8d959e-9cdc3-minion-group-kvtg_cc55383e-bc23-4588-af9a-6af128d242d7 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-8513/pvc-nxppm" Jan 22 06:58:59.657: INFO: At 2021-01-22 06:57:04 +0000 UTC - event for pvc-nxppm: {pd.csi.storage.gke.io_e2e-eefa8d959e-9cdc3-minion-group-kvtg_cc55383e-bc23-4588-af9a-6af128d242d7 } ProvisioningSucceeded: Successfully provisioned volume pvc-5cff3a36-3bca-49f0-9bd9-03cc889d142c Jan 22 06:58:59.657: INFO: At 2021-01-22 06:57:13 +0000 UTC - event for restored-pvc-tester-42z4m: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-5cff3a36-3bca-49f0-9bd9-03cc889d142c" Jan 22 06:58:59.657: INFO: At 2021-01-22 06:57:39 +0000 UTC - event for restored-pvc-tester-42z4m: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.26" already present on machine Jan 22 06:58:59.657: INFO: At 2021-01-22 06:57:39 +0000 UTC - event for restored-pvc-tester-42z4m: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Created: Created container volume-tester Jan 22 06:58:59.657: INFO: At 2021-01-22 06:57:41 +0000 UTC - event for restored-pvc-tester-42z4m: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Started: Started container volume-tester Jan 22 06:58:59.657: INFO: At 2021-01-22 06:58:45 +0000 UTC - event for restored-pvc-tester-42z4m: {kubelet e2e-eefa8d959e-9cdc3-windows-node-group-w85f} Killing: Stopping container volume-tester Jan 22 06:58:59.696: INFO: POD NODE PHASE GRACE CONDITIONS Jan 22 06:58:59.696: INFO: Jan 22 06:58:59.742: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-master Jan 22 06:58:59.782: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-master 80aa5118-1a1d-43f8-97a9-84d9ffbf3002 10301 0 2021-01-22 06:09:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 06:09:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2021-01-22 06:37:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 06:41:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3866853376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3604709376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:09:24 +0000 UTC,LastTransitionTime:2021-01-22 06:09:24 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.193.2,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-master.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-master.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:17a0e186650a97c2461075fbde687797,SystemUUID:17a0e186-650a-97c2-4610-75fbde687797,BootID:773ab65b-b4c0-4828-86b8-fd5a140c9def,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.21.0-alpha.1.250_88c652c154c1e3],SizeBytes:123005230,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.21.0-alpha.1.250_88c652c154c1e3],SizeBytes:117520714,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:70314596,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.21.0-alpha.1.250_88c652c154c1e3],SizeBytes:47716661,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 06:58:59.782: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-master Jan 22 06:58:59.822: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-master Jan 22 06:58:59.871: INFO: kube-controller-manager-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:33 +0000 UTC (0+1 container statuses recorded) Jan 22 06:58:59.871: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 22 06:58:59.871: INFO: kube-scheduler-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:43 +0000 UTC (0+1 container statuses recorded) Jan 22 06:58:59.871: INFO: Container kube-scheduler ready: true, restart count 0 Jan 22 06:58:59.871: INFO: kube-addon-manager-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:58:59.871: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 22 06:58:59.871: INFO: csi-gce-pd-node-s2j9j started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:58:59.871: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:58:59.871: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 06:58:59.871: INFO: etcd-server-events-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:03 +0000 UTC (0+1 container statuses recorded) Jan 22 06:58:59.871: INFO: Container etcd-container ready: true, restart count 0 Jan 22 06:58:59.871: INFO: etcd-server-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:13 +0000 UTC (0+1 container statuses recorded) Jan 22 06:58:59.871: INFO: Container etcd-container ready: true, restart count 0 Jan 22 06:58:59.871: INFO: kube-apiserver-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:08:23 +0000 UTC (0+1 container statuses recorded) Jan 22 06:58:59.871: INFO: Container kube-apiserver ready: true, restart count 0 Jan 22 06:58:59.872: INFO: l7-lb-controller-e2e-eefa8d959e-9cdc3-master started at 2021-01-22 06:09:09 +0000 UTC (0+1 container statuses recorded) Jan 22 06:58:59.872: INFO: Container l7-lb-controller ready: true, restart count 0 Jan 22 06:58:59.872: INFO: metadata-proxy-v0.1-72drn started at 2021-01-22 06:09:42 +0000 UTC (0+2 container statuses recorded) Jan 22 06:58:59.872: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 06:58:59.872: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 W0122 06:58:59.920310 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:59:00.197: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-master Jan 22 06:59:00.197: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-minion-group-kvtg Jan 22 06:59:00.237: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-minion-group-kvtg b6dd2d66-53b4-4ef3-9c96-3c75e822f017 10302 0 2021-01-22 06:09:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-minion-group-kvtg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-minion-group-kvtg"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 06:09:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-22 06:09:35 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-22 06:37:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 06:41:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-minion-group-kvtg,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:09:30 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.6,},NodeAddress{Type:ExternalIP,Address:34.82.120.217,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-minion-group-kvtg.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-minion-group-kvtg.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ca28c70b44a8b1feddc8608aefea1d37,SystemUUID:ca28c70b-44a8-b1fe-ddc8-608aefea1d37,BootID:78efbb40-4d09-4a7d-b071-7f6aca00968d,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.250_88c652c154c1e3],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:70314596,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:bec571992d40203edcd056ac0b0d97003887ee5e4be144c41932d18639673b03 k8s.gcr.io/sig-storage/csi-provisioner:v2.0.4],SizeBytes:20428748,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:e5ce22ddc2a6fbc9b5729dbcfaf1159c4b0d48dad62ddd1b93503c1348e4a406 k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.1],SizeBytes:19498883,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:ca160717df7f6b7964c936faf608b914f2277363e6d708ea2e2dbbf2c5f56a83 k8s.gcr.io/sig-storage/csi-resizer:v1.0.1],SizeBytes:19463877,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:7495d30800fb3ef22f3dc6d5fe9a0a6ec40ba32a2bdc0cf5e7fcaa507adc921e k8s.gcr.io/sig-storage/csi-attacher:v3.0.1],SizeBytes:19460260,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 06:59:00.238: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-minion-group-kvtg Jan 22 06:59:00.278: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-minion-group-kvtg Jan 22 06:59:00.340: INFO: metrics-server-v0.3.6-8b98f98c9-wnr9f started at 2021-01-22 06:10:15 +0000 UTC (0+2 container statuses recorded) Jan 22 06:59:00.340: INFO: Container metrics-server ready: true, restart count 0 Jan 22 06:59:00.340: INFO: Container metrics-server-nanny ready: true, restart count 0 Jan 22 06:59:00.340: INFO: csi-gce-pd-node-q7v2v started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:59:00.340: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:59:00.340: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 22 06:59:00.340: INFO: kube-proxy-e2e-eefa8d959e-9cdc3-minion-group-kvtg started at 2021-01-22 06:09:30 +0000 UTC (0+1 container statuses recorded) Jan 22 06:59:00.340: INFO: Container kube-proxy ready: true, restart count 0 Jan 22 06:59:00.340: INFO: metadata-proxy-v0.1-zpr79 started at 2021-01-22 06:09:30 +0000 UTC (0+2 container statuses recorded) Jan 22 06:59:00.340: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 06:59:00.340: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 22 06:59:00.340: INFO: coredns-6954c77b9b-dsgss started at 2021-01-22 06:09:43 +0000 UTC (0+1 container statuses recorded) Jan 22 06:59:00.340: INFO: Container coredns ready: true, restart count 0 Jan 22 06:59:00.340: INFO: kube-dns-autoscaler-76478fcf46-6nmmv started at 2021-01-22 06:09:46 +0000 UTC (0+1 container statuses recorded) Jan 22 06:59:00.340: INFO: Container autoscaler ready: true, restart count 0 Jan 22 06:59:00.340: INFO: csi-gce-pd-controller-56b4c5f5d-tglnh started at 2021-01-22 06:37:05 +0000 UTC (0+5 container statuses recorded) Jan 22 06:59:00.341: INFO: Container csi-attacher ready: true, restart count 0 Jan 22 06:59:00.341: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 06:59:00.341: INFO: Container csi-resizer ready: true, restart count 0 Jan 22 06:59:00.341: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 22 06:59:00.341: INFO: Container gce-pd-driver ready: true, restart count 0 W0122 06:59:00.391159 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:59:00.636: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-minion-group-kvtg Jan 22 06:59:00.636: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-minion-group-qw6h Jan 22 06:59:00.677: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-minion-group-qw6h 7d8bdad8-f155-4939-acd3-b095371d9a43 10303 0 2021-01-22 06:09:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-minion-group-qw6h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-minion-group-qw6h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 06:09:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.5.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {node-problem-detector Update v1 2021-01-22 06:09:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2021-01-22 06:37:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-22 06:41:32 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.5.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-minion-group-qw6h,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/os,Value:linux,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.5.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7823970304 0} {<nil>} 7640596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7561826304 0} {<nil>} 7384596Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2021-01-22 06:54:40 +0000 UTC,LastTransitionTime:2021-01-22 06:09:35 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:09:30 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:57:39 +0000 UTC,LastTransitionTime:2021-01-22 06:09:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.7,},NodeAddress{Type:ExternalIP,Address:34.82.85.149,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-minion-group-qw6h.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-minion-group-qw6h.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a01d150196c5cf134c7cc21e439a9223,SystemUUID:a01d1501-96c5-cf13-4c7c-c21e439a9223,BootID:996d1268-4a57-4ff9-956b-07f1a1f1ba0b,KernelVersion:5.4.49+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.1,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.0-alpha.1.250_88c652c154c1e3],SizeBytes:120398193,},ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:70314596,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:a494ff6ec10e05a454458fbf44247d93c9b3a0d983a00b538e442f353b7030c8 k8s.gcr.io/sig-storage/snapshot-controller:v3.0.2],SizeBytes:17461280,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1],SizeBytes:8415088,},ContainerImage{Names:[k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 k8s.gcr.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Jan 22 06:59:00.678: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-minion-group-qw6h Jan 22 06:59:00.726: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-minion-group-qw6h Jan 22 06:59:00.785: INFO: coredns-6954c77b9b-cc9f4 started at 2021-01-22 06:09:49 +0000 UTC (0+1 container statuses recorded) Jan 22 06:59:00.785: INFO: Container coredns ready: true, restart count 0 Jan 22 06:59:00.785: INFO: kube-proxy-e2e-eefa8d959e-9cdc3-minion-group-qw6h started at 2021-01-22 06:09:30 +0000 UTC (0+1 container statuses recorded) Jan 22 06:59:00.785: INFO: Container kube-proxy ready: true, restart count 0 Jan 22 06:59:00.785: INFO: metadata-proxy-v0.1-5blbg started at 2021-01-22 06:09:30 +0000 UTC (0+2 container statuses recorded) Jan 22 06:59:00.785: INFO: Container metadata-proxy ready: true, restart count 0 Jan 22 06:59:00.785: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 22 06:59:00.785: INFO: volume-snapshot-controller-0 started at 2021-01-22 06:09:43 +0000 UTC (0+1 container statuses recorded) Jan 22 06:59:00.785: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jan 22 06:59:00.785: INFO: l7-default-backend-6dd8477499-kg5fc started at 2021-01-22 06:09:44 +0000 UTC (0+1 container statuses recorded) Jan 22 06:59:00.785: INFO: Container default-http-backend ready: true, restart count 0 Jan 22 06:59:00.785: INFO: csi-gce-pd-node-chvc2 started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:59:00.785: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:59:00.785: INFO: Container gce-pd-driver ready: true, restart count 0 W0122 06:59:00.833493 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:59:01.018: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-minion-group-qw6h Jan 22 06:59:01.018: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-windows-node-group-23gm Jan 22 06:59:01.057: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-windows-node-group-23gm a80ad4eb-6e61-432d-a9c9-73422b201cf6 10286 0 2021-01-22 06:12:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-windows-node-group-23gm kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-windows-node-group-23gm"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 06:56:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet.exe Update v1 2021-01-22 06:57:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-windows-node-group-23gm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:12:01 +0000 UTC,LastTransitionTime:2021-01-22 06:12:01 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:37 +0000 UTC,LastTransitionTime:2021-01-22 06:12:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:37 +0000 UTC,LastTransitionTime:2021-01-22 06:12:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:37 +0000 UTC,LastTransitionTime:2021-01-22 06:12:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:57:37 +0000 UTC,LastTransitionTime:2021-01-22 06:12:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.203.140.229,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-windows-node-group-23gm.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-windows-node-group-23gm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-eefa8d959e-9cdc3-windows-node-group-23gm,SystemUUID:B5B55A0B-06E2-16DD-4FBE-5E4293EDBC5E,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 22 06:59:01.057: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-windows-node-group-23gm Jan 22 06:59:01.097: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-windows-node-group-23gm Jan 22 06:59:01.157: INFO: csi-gce-pd-node-win-sxkkw started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:59:01.157: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:59:01.157: INFO: Container gce-pd-driver ready: true, restart count 0 W0122 06:59:01.205355 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:59:01.427: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-windows-node-group-23gm Jan 22 06:59:01.427: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-windows-node-group-9zhd Jan 22 06:59:01.467: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-windows-node-group-9zhd b05f7098-725c-4874-9d4a-b394bb855f48 10105 0 2021-01-22 06:11:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-windows-node-group-9zhd kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-windows-node-group-9zhd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-22 06:47:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet.exe Update v1 2021-01-22 06:56:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastTransitionTime":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-windows-node-group-9zhd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:11:51 +0000 UTC,LastTransitionTime:2021-01-22 06:11:51 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:56:52 +0000 UTC,LastTransitionTime:2021-01-22 06:11:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:56:52 +0000 UTC,LastTransitionTime:2021-01-22 06:11:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:56:52 +0000 UTC,LastTransitionTime:2021-01-22 06:11:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:56:52 +0000 UTC,LastTransitionTime:2021-01-22 06:12:01 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.64.127,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-windows-node-group-9zhd.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-windows-node-group-9zhd,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-eefa8d959e-9cdc3-windows-node-group-9zhd,SystemUUID:2DA68E54-6BA1-E4AE-B916-015B98FE74EC,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 22 06:59:01.467: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-windows-node-group-9zhd Jan 22 06:59:01.508: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-windows-node-group-9zhd Jan 22 06:59:01.559: INFO: csi-gce-pd-node-win-dlnrr started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:59:01.559: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:59:01.559: INFO: Container gce-pd-driver ready: true, restart count 0 W0122 06:59:01.606194 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:59:01.875: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-windows-node-group-9zhd Jan 22 06:59:01.875: INFO: Logging node info for node e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:59:01.915: INFO: Node Info: &Node{ObjectMeta:{e2e-eefa8d959e-9cdc3-windows-node-group-w85f 5e0bb3ac-2ba4-4b12-8792-fc676012dc0e 10195 0 2021-01-22 06:11:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-eefa8d959e-9cdc3-windows-node-group-w85f kubernetes.io/os:windows node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/windows-build:10.0.17763 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/instances/e2e-eefa8d959e-9cdc3-windows-node-group-w85f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-22 06:57:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-01-22 06:57:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-m-1-6-ctl-skw-srl/us-west1-b/e2e-eefa8d959e-9cdc3-windows-node-group-w85f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{107252527104 0} {<nil>} 104738796Ki BinarySI},memory: {{8051777536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{96527274234 0} {<nil>} 96527274234 DecimalSI},memory: {{7789633536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-01-22 06:11:58 +0000 UTC,LastTransitionTime:2021-01-22 06:11:58 +0000 UTC,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:12 +0000 UTC,LastTransitionTime:2021-01-22 06:11:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:12 +0000 UTC,LastTransitionTime:2021-01-22 06:11:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-22 06:57:12 +0000 UTC,LastTransitionTime:2021-01-22 06:11:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-22 06:57:12 +0000 UTC,LastTransitionTime:2021-01-22 06:12:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.105.96.73,},NodeAddress{Type:InternalDNS,Address:e2e-eefa8d959e-9cdc3-windows-node-group-w85f.c.k8s-gce-cvm-m-1-6-ctl-skw-srl.internal,},NodeAddress{Type:Hostname,Address:e2e-eefa8d959e-9cdc3-windows-node-group-w85f,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e2e-eefa8d959e-9cdc3-windows-node-group-w85f,SystemUUID:294CB3B9-32A9-24A5-3F1B-36AF69CE4C9D,BootID:,KernelVersion:10.0.17763.1457,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.250+88c652c154c1e3,KubeProxyVersion:v1.21.0-alpha.1.250+88c652c154c1e3,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver@sha256:5096e672d2c615037f00d3875b368c30092960ceb3bb6e4882d136edebb8f113 gcr.io/k8s-gce-cvm-m-1-6-ctl-skw-srl/gcp-persistent-disk-csi-driver:396e5c79-0811-44e5-9a61-9a1b00e73ad9],SizeBytes:5250562040,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:5239823710,},ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:0197a95621a4dc47eb5635f664459a86ec7110d04a99438a54af77bd982487ec mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5055393357,},ContainerImage{Names:[gcr.io/gke-release/pause-win@sha256:15e2ba1c75c5767e6b75fbf2996706a8067471405cc0503cb436f118d264d618 gcr.io/gke-release/pause-win:1.2.1],SizeBytes:4940450714,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:a3f7549ea04c419276e8b84e90a515bbce5bc8a057be2ed974ec45492eca346e k8s.gcr.io/e2e-test-images/agnhost:2.26],SizeBytes:535524317,},ContainerImage{Names:[gcr.io/k8s-staging-csi/csi-node-driver-registrar@sha256:2c2115739bf33418f39b2d4ee4d2dffc10c4e6e16a6ab9bcef7c735f31e223a5 gcr.io/k8s-staging-csi/csi-node-driver-registrar:amd64-windows-canary],SizeBytes:265379831,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-5cff3a36-3bca-49f0-9bd9-03cc889d142c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-m-1-6-ctl-skw-srl/zones/us-west1-b/disks/pvc-5cff3a36-3bca-49f0-9bd9-03cc889d142c,DevicePath:,},},Config:nil,},} Jan 22 06:59:01.915: INFO: Logging kubelet events for node e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:59:01.963: INFO: Logging pods the kubelet thinks is on node e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:59:02.005: INFO: csi-gce-pd-node-win-9gdwx started at 2021-01-22 06:37:05 +0000 UTC (0+2 container statuses recorded) Jan 22 06:59:02.005: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 22 06:59:02.005: INFO: Container gce-pd-driver ready: true, restart count 0 W0122 06:59:02.053981 68194 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 22 06:59:02.252: INFO: Latency metrics for node e2e-eefa8d959e-9cdc3-windows-node-group-w85f Jan 22 06:59:02.252: INFO: Waiting up to 3m0s for all (but 3) nodes to be ready �[1mSTEP�[0m: Destroying namespace "snapshotting-8513" for this suite.
Filter through log files | View test history on testgrid
Check APIReachability
Deferred TearDown
DumpClusterLogs
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion
Extract
TearDown
TearDown Previous
Timeout
Up
diffResources
list nodes
listResources After
listResources Before
listResources Down
listResources Up
test setup
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail in binding dynamic provisioned PV to PVC [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (block volmode)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (delayed binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (immediate binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][sig-windows] volume-expand Verify if offline PVC expansion works
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][sig-windows] volume-expand should resize volume when PVC is edited while pod is using it
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with pvc data source
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] provisioning should provision storage with pvc data source in parallel [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (ntfs)][sig-windows] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable-stress[Feature:VolumeSnapshotDataSource] should support snapshotting of many volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable-stress[Feature:VolumeSnapshotDataSource] should support snapshotting of many volumes repeatedly [Slow] [Serial]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (immediate-binding)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should create read-only inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should create read/write inline ephemeral volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should support multiple inline ephemeral volumes
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Generic Ephemeral-volume (default fs) [Feature:GenericEphemeralVolume] (late-binding)] ephemeral should support two pods which share the same volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Inline-volume (xfs)][Slow] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to create pod by failing to mount volume [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow][LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext3)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ntfs)][sig-windows] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (ntfs)][sig-windows] volumes should store data
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should allow exec of files on the volume
External Storage [Driver: csi-gcepd-sc-windows] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should store data