ci-kubernetes-e2e-snapshot #1538035592653180928
Recent runs || View in Spyglass
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\sAfterSuite$'
test/e2e/e2e.go:87
Jun 18 07:43:17.694: VolumeSnapshot snapshot-9vktx is not ready within 5m0s
test/e2e/storage/utils/snapshot.go:86
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\scsi\-hostpath\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\]\sprovisioning\sshould\sprovision\sstorage\swith\ssnapshot\sdata\ssource\s\[Feature\:VolumeSnapshotDataSource\]$'
test/e2e/storage/testsuites/provisioning.go:208 Jun 18 05:59:40.551: VolumeSnapshot snapshot-zq48h is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 18 05:54:06.713: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource] test/e2e/storage/testsuites/provisioning.go:208 �[1mSTEP�[0m: Building a driver namespace object, basename provisioning-1939 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi-hostpath driver Jun 18 05:54:07.287: INFO: creating *v1.ServiceAccount: provisioning-1939-7010/csi-attacher Jun 18 05:54:07.323: INFO: creating *v1.ClusterRole: external-attacher-runner-provisioning-1939 Jun 18 05:54:07.323: INFO: Define cluster role external-attacher-runner-provisioning-1939 Jun 18 05:54:07.364: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-provisioning-1939 Jun 18 05:54:07.401: INFO: creating *v1.Role: provisioning-1939-7010/external-attacher-cfg-provisioning-1939 Jun 18 05:54:07.438: INFO: creating *v1.RoleBinding: provisioning-1939-7010/csi-attacher-role-cfg Jun 18 05:54:07.475: INFO: creating *v1.ServiceAccount: provisioning-1939-7010/csi-provisioner Jun 18 05:54:07.512: INFO: creating *v1.ClusterRole: external-provisioner-runner-provisioning-1939 Jun 18 05:54:07.512: INFO: Define cluster role external-provisioner-runner-provisioning-1939 Jun 18 05:54:07.550: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-provisioning-1939 Jun 18 05:54:07.588: INFO: creating *v1.Role: provisioning-1939-7010/external-provisioner-cfg-provisioning-1939 Jun 18 05:54:07.625: INFO: creating *v1.RoleBinding: provisioning-1939-7010/csi-provisioner-role-cfg Jun 18 05:54:07.662: INFO: creating *v1.ServiceAccount: provisioning-1939-7010/csi-snapshotter Jun 18 05:54:07.701: INFO: creating *v1.ClusterRole: external-snapshotter-runner-provisioning-1939 Jun 18 05:54:07.701: INFO: Define cluster role external-snapshotter-runner-provisioning-1939 Jun 18 05:54:07.739: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-provisioning-1939 Jun 18 05:54:07.775: INFO: creating *v1.Role: provisioning-1939-7010/external-snapshotter-leaderelection-provisioning-1939 Jun 18 05:54:07.812: INFO: creating *v1.RoleBinding: provisioning-1939-7010/external-snapshotter-leaderelection Jun 18 05:54:07.851: INFO: creating *v1.ServiceAccount: provisioning-1939-7010/csi-external-health-monitor-controller Jun 18 05:54:07.888: INFO: creating *v1.ClusterRole: external-health-monitor-controller-runner-provisioning-1939 Jun 18 05:54:07.888: INFO: Define cluster role external-health-monitor-controller-runner-provisioning-1939 Jun 18 05:54:07.926: INFO: creating *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-provisioning-1939 Jun 18 05:54:08.019: INFO: creating *v1.Role: provisioning-1939-7010/external-health-monitor-controller-cfg-provisioning-1939 Jun 18 05:54:08.057: INFO: creating *v1.RoleBinding: provisioning-1939-7010/csi-external-health-monitor-controller-role-cfg Jun 18 05:54:08.099: INFO: creating *v1.ServiceAccount: provisioning-1939-7010/csi-resizer Jun 18 05:54:08.137: INFO: creating *v1.ClusterRole: external-resizer-runner-provisioning-1939 Jun 18 05:54:08.137: INFO: Define cluster role external-resizer-runner-provisioning-1939 Jun 18 05:54:08.176: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-provisioning-1939 Jun 18 05:54:08.215: INFO: creating *v1.Role: provisioning-1939-7010/external-resizer-cfg-provisioning-1939 Jun 18 05:54:08.253: INFO: creating *v1.RoleBinding: provisioning-1939-7010/csi-resizer-role-cfg Jun 18 05:54:08.290: INFO: creating *v1.CSIDriver: csi-hostpath-provisioning-1939 Jun 18 05:54:08.328: INFO: creating *v1.ServiceAccount: provisioning-1939-7010/csi-hostpathplugin-sa Jun 18 05:54:08.367: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-provisioning-1939 Jun 18 05:54:08.405: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-provisioning-1939 Jun 18 05:54:08.443: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-provisioning-1939 Jun 18 05:54:08.479: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-provisioning-1939 Jun 18 05:54:08.517: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-provisioning-1939 Jun 18 05:54:08.555: INFO: creating *v1.RoleBinding: provisioning-1939-7010/csi-hostpathplugin-attacher-role Jun 18 05:54:08.599: INFO: creating *v1.RoleBinding: provisioning-1939-7010/csi-hostpathplugin-health-monitor-controller-role Jun 18 05:54:08.638: INFO: creating *v1.RoleBinding: provisioning-1939-7010/csi-hostpathplugin-provisioner-role Jun 18 05:54:08.693: INFO: creating *v1.RoleBinding: provisioning-1939-7010/csi-hostpathplugin-resizer-role Jun 18 05:54:08.731: INFO: creating *v1.RoleBinding: provisioning-1939-7010/csi-hostpathplugin-snapshotter-role Jun 18 05:54:08.769: INFO: creating *v1.StatefulSet: provisioning-1939-7010/csi-hostpathplugin Jun 18 05:54:08.811: INFO: creating *v1.ClusterRoleBinding: psp-csi-hostpath-role-provisioning-1939 Jun 18 05:54:08.857: INFO: In creating storage class object and pvc objects for driver - sc: &StorageClass{ObjectMeta:{provisioning-1939lbtck 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Provisioner:csi-hostpath-provisioning-1939,Parameters:map[string]string{},ReclaimPolicy:nil,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},}, pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-1939 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1048576 0} {<nil>} 1Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-1939lbtck,VolumeMode:*Block,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},}, src-pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-1939 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1048576 0} {<nil>} 1Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-1939lbtck,VolumeMode:*Block,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: Creating a StorageClass �[1mSTEP�[0m: [Initialize dataSource]creating a initClaim �[1mSTEP�[0m: starting hostpath-injector Jun 18 05:54:09.086: INFO: Waiting up to 5m0s for pod "hostpath-injector" in namespace "provisioning-1939" to be "running" Jun 18 05:54:09.138: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 52.672851ms Jun 18 05:54:11.175: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.088889371s Jun 18 05:54:13.175: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.089593162s Jun 18 05:54:15.174: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.088565374s Jun 18 05:54:17.175: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.089084744s Jun 18 05:54:19.175: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 10.089650688s Jun 18 05:54:21.174: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 12.088720909s Jun 18 05:54:23.176: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 14.089791806s Jun 18 05:54:25.175: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 16.088790633s Jun 18 05:54:27.176: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 18.089767013s Jun 18 05:54:29.176: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 20.090636359s Jun 18 05:54:31.176: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 22.090430981s Jun 18 05:54:33.174: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 24.088446s Jun 18 05:54:35.176: INFO: Pod "hostpath-injector": Phase="Running", Reason="", readiness=true. Elapsed: 26.090322068s Jun 18 05:54:35.176: INFO: Pod "hostpath-injector" satisfied condition "running" �[1mSTEP�[0m: Writing text file contents in the container. Jun 18 05:54:35.176: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.83.44.136 --kubeconfig=/workspace/.kube/config --namespace=provisioning-1939 exec hostpath-injector --namespace=provisioning-1939 -- /bin/sh -c echo 'Hello from namespace provisioning-1939' > /opt/0' Jun 18 05:54:35.655: INFO: stderr: "" Jun 18 05:54:35.655: INFO: stdout: "" �[1mSTEP�[0m: Checking that text file contents are perfect. Jun 18 05:54:35.655: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.83.44.136 --kubeconfig=/workspace/.kube/config --namespace=provisioning-1939 exec hostpath-injector --namespace=provisioning-1939 -- head -c 38 /opt/0' Jun 18 05:54:36.115: INFO: stderr: "" Jun 18 05:54:36.115: INFO: stdout: "Hello from namespace provisioning-1939" Jun 18 05:54:36.115: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:provisioning-1939 PodName:hostpath-injector ContainerName:hostpath-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 18 05:54:36.115: INFO: >>> kubeConfig: /workspace/.kube/config Jun 18 05:54:36.116: INFO: ExecWithOptions: Clientset creation Jun 18 05:54:36.116: INFO: ExecWithOptions: execute(POST https://34.83.44.136/api/v1/namespaces/provisioning-1939/pods/hostpath-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=hostpath-injector&container=hostpath-injector&stderr=true&stdout=true) Jun 18 05:54:36.398: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:provisioning-1939 PodName:hostpath-injector ContainerName:hostpath-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 18 05:54:36.399: INFO: >>> kubeConfig: /workspace/.kube/config Jun 18 05:54:36.399: INFO: ExecWithOptions: Clientset creation Jun 18 05:54:36.399: INFO: ExecWithOptions: execute(POST https://34.83.44.136/api/v1/namespaces/provisioning-1939/pods/hostpath-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=hostpath-injector&container=hostpath-injector&stderr=true&stdout=true) �[1mSTEP�[0m: Deleting pod hostpath-injector in namespace provisioning-1939 Jun 18 05:54:36.723: INFO: Waiting for pod hostpath-injector to disappear Jun 18 05:54:36.758: INFO: Pod hostpath-injector still exists Jun 18 05:54:38.759: INFO: Waiting for pod hostpath-injector to disappear Jun 18 05:54:38.794: INFO: Pod hostpath-injector no longer exists �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 18 05:54:38.910: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-zq48h to become ready Jun 18 05:54:38.956: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:54:40.994: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:54:43.031: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:54:45.070: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:54:47.106: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:54:49.143: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:54:51.180: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:54:53.217: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:54:55.254: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:54:57.291: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:54:59.329: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:01.367: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:03.404: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:05.442: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:07.479: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:09.518: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:11.555: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:13.591: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:15.628: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:17.669: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:19.706: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:21.744: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:23.782: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:25.818: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:27.855: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:29.891: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:31.928: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:33.964: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:36.000: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:38.036: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:40.073: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:42.110: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:44.146: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:46.184: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:48.220: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:50.256: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:52.293: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:54.329: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:56.367: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:55:58.405: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:00.443: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:02.480: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:04.518: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:06.556: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:08.595: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:10.632: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:12.671: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:14.761: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:16.798: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:18.836: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:20.877: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:22.913: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:24.949: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:26.986: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:29.024: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:31.060: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:33.096: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:35.134: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:37.171: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:39.208: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:41.245: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:43.282: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:45.319: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:47.356: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:49.393: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:51.431: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:53.468: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:55.505: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:57.543: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:56:59.580: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:01.618: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:03.655: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:05.706: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:07.743: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:09.779: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:11.816: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:13.858: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:15.897: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:17.933: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:19.970: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:22.006: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:24.042: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:26.079: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:28.116: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:30.153: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:32.190: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:34.227: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:36.264: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:38.300: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:40.337: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:42.373: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:44.411: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:46.447: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:48.483: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:50.521: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:52.558: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:54.595: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:56.633: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:57:58.669: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:00.706: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:02.744: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:04.781: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:06.819: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:08.857: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:10.895: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:12.931: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:14.968: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:17.004: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:19.043: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:21.079: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:23.116: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:25.152: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:27.190: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:29.228: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:31.265: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:33.301: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:35.338: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:37.375: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:39.412: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:41.450: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:43.487: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:45.523: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:47.562: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:49.598: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:51.635: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:53.677: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:55.715: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:57.751: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:58:59.789: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:01.826: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:03.863: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:05.960: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:07.997: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:10.034: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:12.070: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:14.107: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:16.144: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:18.181: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:20.217: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:22.255: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:24.293: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:26.330: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:28.367: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:30.404: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:32.440: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:34.477: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:36.514: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:38.551: INFO: VolumeSnapshot snapshot-zq48h found but is not ready. Jun 18 05:59:40.551: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 18 05:59:40.551: INFO: Unexpected error: <*errors.errorString | 0xc0034e0bc0>: { s: "VolumeSnapshot snapshot-zq48h is not ready within 5m0s", } Jun 18 05:59:40.551: FAIL: VolumeSnapshot snapshot-zq48h is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc0031962b0?}, 0xc003197df0) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7fdc384f5248, 0xc0011a6c00}, 0xc002a67080, {{0x71975b3, 0x1a}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage/testsuites.prepareSnapshotDataSourceForProvisioning(_, {{0xc000f01518, 0x11}, {0x713b04a, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...) test/e2e/storage/testsuites/provisioning.go:1090 +0x41f k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() test/e2e/storage/testsuites/provisioning.go:227 +0x485 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24d6d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007ba680, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: creating claim=&PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-1939 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1048576 0} {<nil>} 1Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-1939lbtck,VolumeMode:*Block,DataSource:&TypedLocalObjectReference{APIGroup:*snapshot.storage.k8s.io,Kind:VolumeSnapshot,Name:snapshot-zq48h,},DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: checking whether the created volume has the pre-populated data �[1mSTEP�[0m: starting hostpath-client Jun 18 05:59:40.669: INFO: Waiting up to 15m0s for pod "hostpath-client" in namespace "provisioning-1939" to be "running" Jun 18 05:59:40.704: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 35.027903ms Jun 18 05:59:42.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2.072372221s Jun 18 05:59:44.739: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4.070180548s Jun 18 05:59:46.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6.071783495s Jun 18 05:59:48.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8.071219531s Jun 18 05:59:50.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10.070784102s Jun 18 05:59:52.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12.070724469s Jun 18 05:59:54.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14.071280952s Jun 18 05:59:56.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 16.071398618s Jun 18 05:59:58.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 18.071059503s Jun 18 06:00:00.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 20.072079488s Jun 18 06:00:02.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 22.071369542s Jun 18 06:00:04.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 24.071987319s Jun 18 06:00:06.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 26.071839739s Jun 18 06:00:08.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 28.070981474s Jun 18 06:00:10.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 30.071433162s Jun 18 06:00:12.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 32.071788659s Jun 18 06:00:14.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 34.071592411s Jun 18 06:00:16.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 36.07123793s Jun 18 06:00:18.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 38.071792108s Jun 18 06:00:20.742: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 40.072502999s Jun 18 06:00:22.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 42.071547765s Jun 18 06:00:24.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 44.072098396s Jun 18 06:00:26.759: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 46.090253059s Jun 18 06:00:28.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 48.072158011s Jun 18 06:00:30.742: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 50.072619643s Jun 18 06:00:32.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 52.07177139s Jun 18 06:00:34.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 54.070899515s Jun 18 06:00:36.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 56.071633747s Jun 18 06:00:38.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 58.07163344s Jun 18 06:00:40.742: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.072825725s Jun 18 06:00:42.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.072194711s Jun 18 06:00:44.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.071776289s Jun 18 06:00:46.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.071124833s Jun 18 06:00:48.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.071926784s Jun 18 06:00:50.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.072019108s Jun 18 06:00:52.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.072190478s Jun 18 06:00:54.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.072048204s Jun 18 06:00:56.742: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.072743652s Jun 18 06:00:58.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.072262325s Jun 18 06:01:00.742: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.072597071s Jun 18 06:01:02.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.071821829s Jun 18 06:01:04.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.071350279s Jun 18 06:01:06.741: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.071859075s Jun 18 06:01:08.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.071244705s Jun 18 06:01:10.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.13353442s Jun 18 06:01:12.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.083231415s Jun 18 06:01:14.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.13385178s Jun 18 06:01:16.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.083176525s Jun 18 06:01:18.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.083648401s Jun 18 06:01:20.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.133263123s Jun 18 06:01:22.800: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.131029872s Jun 18 06:01:24.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.133860438s Jun 18 06:01:26.807: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.137860275s Jun 18 06:01:28.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.133434092s Jun 18 06:01:30.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.133791467s Jun 18 06:01:32.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.083293458s Jun 18 06:01:34.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.132965725s Jun 18 06:01:36.837: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.167606358s Jun 18 06:01:38.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.083494405s Jun 18 06:01:40.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.083420039s Jun 18 06:01:42.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.082773283s Jun 18 06:01:44.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.133905672s Jun 18 06:01:46.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.133257738s Jun 18 06:01:48.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.083065117s Jun 18 06:01:50.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.13262677s Jun 18 06:01:52.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.132782166s Jun 18 06:01:54.813: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.143593249s Jun 18 06:01:56.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.083394995s Jun 18 06:01:58.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.133921178s Jun 18 06:02:00.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.13389533s Jun 18 06:02:02.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.13345556s Jun 18 06:02:04.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.133738332s Jun 18 06:02:06.801: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.132182523s Jun 18 06:02:08.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.133204174s Jun 18 06:02:10.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.132842926s Jun 18 06:02:12.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.084046048s Jun 18 06:02:14.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.134098595s Jun 18 06:02:16.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.133878373s Jun 18 06:02:18.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.133838681s Jun 18 06:02:20.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.133290432s Jun 18 06:02:22.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.133515594s Jun 18 06:02:24.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.132994108s Jun 18 06:02:26.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.133228015s Jun 18 06:02:28.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.133685443s Jun 18 06:02:30.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.133404256s Jun 18 06:02:32.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.132686156s Jun 18 06:02:34.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.082829964s Jun 18 06:02:36.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.133073564s Jun 18 06:02:38.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.133457325s Jun 18 06:02:40.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.133567002s Jun 18 06:02:42.757: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.088137344s Jun 18 06:02:44.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.132735406s Jun 18 06:02:46.808: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.139242016s Jun 18 06:02:48.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.133166131s Jun 18 06:02:50.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.133858011s Jun 18 06:02:52.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.13348433s Jun 18 06:02:54.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.133872248s Jun 18 06:02:56.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.084445546s Jun 18 06:02:58.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.133115295s Jun 18 06:03:00.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.083941799s Jun 18 06:03:02.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.083681066s Jun 18 06:03:04.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.132840622s Jun 18 06:03:06.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.133547661s Jun 18 06:03:08.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.133800358s Jun 18 06:03:10.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.132833378s Jun 18 06:03:12.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.083446953s Jun 18 06:03:14.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.133208563s Jun 18 06:03:16.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.13347571s Jun 18 06:03:18.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.132882049s Jun 18 06:03:20.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.133847842s Jun 18 06:03:22.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.083651438s Jun 18 06:03:24.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.133130272s Jun 18 06:03:26.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.133714022s Jun 18 06:03:28.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.133244106s Jun 18 06:03:30.812: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.142483987s Jun 18 06:03:32.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.083519299s Jun 18 06:03:34.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.133752592s Jun 18 06:03:36.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.132935042s Jun 18 06:03:38.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.132996373s Jun 18 06:03:40.804: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.134440844s Jun 18 06:03:42.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.08412185s Jun 18 06:03:44.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.132879864s Jun 18 06:03:46.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.1329609s Jun 18 06:03:48.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.133143859s Jun 18 06:03:50.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.133860812s Jun 18 06:03:52.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.133116783s Jun 18 06:03:54.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.133338886s Jun 18 06:03:56.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.133801466s Jun 18 06:03:58.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.133859543s Jun 18 06:04:00.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.133141717s Jun 18 06:04:02.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.133067096s Jun 18 06:04:04.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.13291321s Jun 18 06:04:06.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.083513435s Jun 18 06:04:08.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.082682598s Jun 18 06:04:10.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.083033512s Jun 18 06:04:12.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.133468843s Jun 18 06:04:14.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.133436923s Jun 18 06:04:16.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.133066502s Jun 18 06:04:18.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.133249485s Jun 18 06:04:20.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.134057913s Jun 18 06:04:22.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.134242538s Jun 18 06:04:24.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.133673271s Jun 18 06:04:26.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.083184722s Jun 18 06:04:28.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.133492666s Jun 18 06:04:30.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.133060496s Jun 18 06:04:32.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.133112872s Jun 18 06:04:34.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.13319629s Jun 18 06:04:36.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.132955919s Jun 18 06:04:38.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.133055032s Jun 18 06:04:40.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.13347319s Jun 18 06:04:42.757: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.088059025s Jun 18 06:04:44.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.071381287s Jun 18 06:04:46.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.133587857s Jun 18 06:04:48.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.13405927s Jun 18 06:04:50.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.133414819s Jun 18 06:04:52.807: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.137463691s Jun 18 06:04:54.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.133198494s Jun 18 06:04:56.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.1341011s Jun 18 06:04:58.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.133492791s Jun 18 06:05:00.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.084181961s Jun 18 06:05:02.788: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.119104405s Jun 18 06:05:04.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.133122174s Jun 18 06:05:06.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.134239915s Jun 18 06:05:08.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.133650819s Jun 18 06:05:10.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.133423977s Jun 18 06:05:12.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.134182001s Jun 18 06:05:14.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m34.133648849s Jun 18 06:05:16.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m36.132741679s Jun 18 06:05:18.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m38.133610969s Jun 18 06:05:20.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m40.133713176s Jun 18 06:05:22.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m42.132748161s Jun 18 06:05:24.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m44.133382827s Jun 18 06:05:26.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m46.134288342s Jun 18 06:05:28.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m48.132902451s Jun 18 06:05:30.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.133847683s Jun 18 06:05:32.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.133970672s Jun 18 06:05:34.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.133750678s Jun 18 06:05:36.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.08284521s Jun 18 06:05:38.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.08369187s Jun 18 06:05:40.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.133390653s Jun 18 06:05:42.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.133800964s Jun 18 06:05:44.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.1336483s Jun 18 06:05:46.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.133371171s Jun 18 06:05:48.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.083254821s Jun 18 06:05:50.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.133912562s Jun 18 06:05:52.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.083076993s Jun 18 06:05:54.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.133767756s Jun 18 06:05:56.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.133779028s Jun 18 06:05:58.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.084154073s Jun 18 06:06:00.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.134095178s Jun 18 06:06:02.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.134078908s Jun 18 06:06:04.804: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.135006872s Jun 18 06:06:06.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.083637088s Jun 18 06:06:08.806: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.136459889s Jun 18 06:06:10.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.133358273s Jun 18 06:06:12.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.133754946s Jun 18 06:06:14.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.083752856s Jun 18 06:06:16.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.133938442s Jun 18 06:06:18.871: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.20157045s Jun 18 06:06:20.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.133983729s Jun 18 06:06:22.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.083766618s Jun 18 06:06:24.804: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m44.135151999s Jun 18 06:06:26.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m46.132878665s Jun 18 06:06:28.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m48.133399648s Jun 18 06:06:30.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m50.132671392s Jun 18 06:06:32.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m52.083746239s Jun 18 06:06:34.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.133186703s Jun 18 06:06:36.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.133964312s Jun 18 06:06:38.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.133265203s Jun 18 06:06:40.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.134054293s Jun 18 06:06:42.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.133522625s Jun 18 06:06:44.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.133255013s Jun 18 06:06:46.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.133534786s Jun 18 06:06:48.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.133454185s Jun 18 06:06:50.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.133644538s Jun 18 06:06:52.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.083938388s Jun 18 06:06:54.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.083075562s Jun 18 06:06:56.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m16.083241782s Jun 18 06:06:58.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m18.133324711s Jun 18 06:07:00.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m20.132874321s Jun 18 06:07:02.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m22.133671409s Jun 18 06:07:04.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m24.133917771s Jun 18 06:07:06.801: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m26.132380592s Jun 18 06:07:08.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m28.083451953s Jun 18 06:07:10.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m30.133518254s Jun 18 06:07:12.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m32.083185462s Jun 18 06:07:14.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m34.133157233s Jun 18 06:07:16.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m36.13251854s Jun 18 06:07:18.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m38.13315182s Jun 18 06:07:20.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m40.133093303s Jun 18 06:07:22.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m42.083478092s Jun 18 06:07:24.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m44.133297412s Jun 18 06:07:26.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m46.133947974s Jun 18 06:07:28.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.134182422s Jun 18 06:07:30.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.132817808s Jun 18 06:07:32.756: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.087034283s Jun 18 06:07:34.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.133463591s Jun 18 06:07:36.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.133249057s Jun 18 06:07:38.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.133190931s Jun 18 06:07:40.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.133377765s Jun 18 06:07:42.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m2.133154579s Jun 18 06:07:44.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m4.133177462s Jun 18 06:07:46.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m6.13407349s Jun 18 06:07:48.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m8.133477105s Jun 18 06:07:50.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m10.133991919s Jun 18 06:07:52.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m12.133647596s Jun 18 06:07:54.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m14.133128556s Jun 18 06:07:56.810: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m16.140556546s Jun 18 06:07:58.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m18.13426912s Jun 18 06:08:00.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m20.133286324s Jun 18 06:08:02.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m22.133696597s Jun 18 06:08:04.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m24.133175156s Jun 18 06:08:06.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m26.133450942s Jun 18 06:08:08.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m28.133932999s Jun 18 06:08:10.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m30.133772643s Jun 18 06:08:12.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.133511071s Jun 18 06:08:14.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.133720713s Jun 18 06:08:16.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.133351552s Jun 18 06:08:18.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.13385611s Jun 18 06:08:20.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.133243409s Jun 18 06:08:22.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.084168423s Jun 18 06:08:24.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.133716196s Jun 18 06:08:26.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m46.133260496s Jun 18 06:08:28.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m48.133354849s Jun 18 06:08:30.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m50.132968265s Jun 18 06:08:32.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m52.132847039s Jun 18 06:08:34.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m54.132918831s Jun 18 06:08:36.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m56.133879862s Jun 18 06:08:38.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m58.13349456s Jun 18 06:08:40.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m0.133272549s Jun 18 06:08:42.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m2.084007967s Jun 18 06:08:44.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m4.082454549s Jun 18 06:08:46.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m6.133077192s Jun 18 06:08:48.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m8.084083007s Jun 18 06:08:50.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m10.133108742s Jun 18 06:08:52.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m12.133275422s Jun 18 06:08:54.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m14.133121594s Jun 18 06:08:56.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m16.133114872s Jun 18 06:08:58.813: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m18.143672717s Jun 18 06:09:00.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m20.133962142s Jun 18 06:09:02.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m22.13383815s Jun 18 06:09:04.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m24.133977755s Jun 18 06:09:06.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m26.085562745s Jun 18 06:09:08.804: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m28.13520469s Jun 18 06:09:10.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m30.13391007s Jun 18 06:09:12.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m32.084647199s Jun 18 06:09:14.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m34.085446951s Jun 18 06:09:16.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m36.133463018s Jun 18 06:09:18.811: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m38.141422199s Jun 18 06:09:20.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m40.085435659s Jun 18 06:09:22.759: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m42.089458923s Jun 18 06:09:24.807: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m44.137508832s Jun 18 06:09:26.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m46.085436224s Jun 18 06:09:28.776: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m48.10714077s Jun 18 06:09:30.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m50.133641296s Jun 18 06:09:32.807: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m52.13743229s Jun 18 06:09:34.807: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m54.137455065s Jun 18 06:09:36.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m56.085447305s Jun 18 06:09:38.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m58.084553936s Jun 18 06:09:40.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m0.0848834s Jun 18 06:09:42.807: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m2.137465369s Jun 18 06:09:44.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m4.085466583s Jun 18 06:09:46.807: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m6.137466351s Jun 18 06:09:48.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m8.085396902s Jun 18 06:09:50.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m10.085552143s Jun 18 06:09:52.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m12.084697743s Jun 18 06:09:54.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m14.083137183s Jun 18 06:09:56.806: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m16.136833963s Jun 18 06:09:58.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m18.133908956s Jun 18 06:10:00.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m20.132844769s Jun 18 06:10:02.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m22.085341378s Jun 18 06:10:04.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m24.133307756s Jun 18 06:10:06.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m26.13363253s Jun 18 06:10:08.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m28.13285765s Jun 18 06:10:10.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m30.083407342s Jun 18 06:10:12.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m32.133570395s Jun 18 06:10:14.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m34.133286949s Jun 18 06:10:16.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m36.132465449s Jun 18 06:10:18.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m38.133405444s Jun 18 06:10:20.740: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m40.070710358s Jun 18 06:10:22.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m42.084791352s Jun 18 06:10:24.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m44.133524452s Jun 18 06:10:26.804: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m46.134958748s Jun 18 06:10:28.762: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m48.093357084s Jun 18 06:10:30.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m50.085433603s Jun 18 06:10:32.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m52.085445736s Jun 18 06:10:34.806: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m54.137236578s Jun 18 06:10:36.756: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m56.086872073s Jun 18 06:10:38.806: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m58.136621261s Jun 18 06:10:40.807: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m0.137451338s Jun 18 06:10:42.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m2.085457101s Jun 18 06:10:44.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m4.083282441s Jun 18 06:10:46.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m6.085403423s Jun 18 06:10:48.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m8.085394259s Jun 18 06:10:50.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m10.085537455s Jun 18 06:10:52.807: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m12.137420615s Jun 18 06:10:54.746: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m14.076430425s Jun 18 06:10:56.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m16.082901897s Jun 18 06:10:58.758: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m18.08901445s Jun 18 06:11:00.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m20.084848346s Jun 18 06:11:02.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m22.085739795s Jun 18 06:11:04.807: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m24.137443264s Jun 18 06:11:06.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m26.08358075s Jun 18 06:11:08.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m28.084469718s Jun 18 06:11:10.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m30.085390282s Jun 18 06:11:12.757: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m32.08756375s Jun 18 06:11:14.807: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m34.137479713s Jun 18 06:11:16.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m36.13370278s Jun 18 06:11:18.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m38.085414274s Jun 18 06:11:20.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m40.085443853s Jun 18 06:11:22.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m42.085385141s Jun 18 06:11:24.806: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m44.137394179s Jun 18 06:11:26.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m46.085383585s Jun 18 06:11:28.806: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m48.137381344s Jun 18 06:11:30.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m50.085399547s Jun 18 06:11:32.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m52.085421657s Jun 18 06:11:34.756: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m54.086675838s Jun 18 06:11:36.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m56.085423332s Jun 18 06:11:38.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m58.085437146s Jun 18 06:11:40.805: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m0.136024995s Jun 18 06:11:42.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m2.132750899s Jun 18 06:11:44.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m4.085413905s Jun 18 06:11:46.759: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m6.08945269s Jun 18 06:11:48.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m8.083564325s Jun 18 06:11:50.805: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m10.135822812s Jun 18 06:11:52.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m12.085726037s Jun 18 06:11:54.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m14.085347742s Jun 18 06:11:56.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m16.133523416s Jun 18 06:11:58.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m18.133850097s Jun 18 06:12:00.818: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m20.148834817s Jun 18 06:12:02.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m22.084391795s Jun 18 06:12:04.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m24.134021279s Jun 18 06:12:06.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m26.084815749s Jun 18 06:12:08.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m28.133175208s Jun 18 06:12:10.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m30.1335384s Jun 18 06:12:12.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m32.084625822s Jun 18 06:12:14.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m34.13335403s Jun 18 06:12:16.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m36.133307787s Jun 18 06:12:18.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m38.08381035s Jun 18 06:12:20.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m40.134372088s Jun 18 06:12:22.756: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m42.086509366s Jun 18 06:12:24.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m44.133855129s Jun 18 06:12:26.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m46.133842448s Jun 18 06:12:28.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m48.133708661s Jun 18 06:12:30.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m50.133715882s Jun 18 06:12:32.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m52.133896374s Jun 18 06:12:34.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m54.133710906s Jun 18 06:12:36.808: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m56.139207009s Jun 18 06:12:38.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m58.083388596s Jun 18 06:12:40.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m0.133558435s Jun 18 06:12:42.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m2.083558431s Jun 18 06:12:44.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m4.133771079s Jun 18 06:12:46.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m6.133618345s Jun 18 06:12:48.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m8.133425808s Jun 18 06:12:50.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m10.084116676s Jun 18 06:12:52.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m12.133774837s Jun 18 06:12:54.805: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m14.135683421s Jun 18 06:12:56.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m16.133390856s Jun 18 06:12:58.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m18.083464468s Jun 18 06:13:00.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m20.133780115s Jun 18 06:13:02.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m22.083676059s Jun 18 06:13:04.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m24.133876909s Jun 18 06:13:06.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m26.133499218s Jun 18 06:13:08.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m28.133457254s Jun 18 06:13:10.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m30.133378819s Jun 18 06:13:12.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m32.13349046s Jun 18 06:13:14.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m34.083217287s Jun 18 06:13:16.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m36.133644623s Jun 18 06:13:18.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m38.133595139s Jun 18 06:13:20.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m40.133501351s Jun 18 06:13:22.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m42.13412431s Jun 18 06:13:24.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m44.08311518s Jun 18 06:13:26.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m46.13436249s Jun 18 06:13:28.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m48.083940533s Jun 18 06:13:30.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m50.13328546s Jun 18 06:13:32.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m52.132818069s Jun 18 06:13:34.826: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m54.156994115s Jun 18 06:13:36.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m56.133064502s Jun 18 06:13:38.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m58.133116308s Jun 18 06:13:40.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m0.133110307s Jun 18 06:13:42.754: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m2.084849565s Jun 18 06:13:44.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m4.133158336s Jun 18 06:13:46.804: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m6.13516493s Jun 18 06:13:48.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m8.13364138s Jun 18 06:13:50.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m10.133362757s Jun 18 06:13:52.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m12.133496908s Jun 18 06:13:54.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m14.133101416s Jun 18 06:13:56.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m16.133863757s Jun 18 06:13:58.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m18.132733147s Jun 18 06:14:00.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m20.083086188s Jun 18 06:14:02.761: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m22.091981923s Jun 18 06:14:04.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m24.133750543s Jun 18 06:14:06.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m26.132669777s Jun 18 06:14:08.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m28.133577013s Jun 18 06:14:10.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m30.133001548s Jun 18 06:14:12.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m32.13304722s Jun 18 06:14:14.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m34.133830835s Jun 18 06:14:16.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m36.133790396s Jun 18 06:14:18.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m38.133106941s Jun 18 06:14:20.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m40.132888537s Jun 18 06:14:22.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m42.134108186s Jun 18 06:14:24.758: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m44.089235155s Jun 18 06:14:26.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m46.083787512s Jun 18 06:14:28.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m48.133260382s Jun 18 06:14:30.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m50.132988359s Jun 18 06:14:32.753: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m52.08403586s Jun 18 06:14:34.802: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m54.133106546s Jun 18 06:14:36.803: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m56.133532222s Jun 18 06:14:38.752: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m58.083372967s Jun 18 06:14:40.757: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.087718313s Jun 18 06:14:40.853: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.183584961s �[1mSTEP�[0m: Deleting pod hostpath-client in namespace provisioning-1939 Jun 18 06:14:40.965: INFO: Waiting for pod hostpath-client to disappear Jun 18 06:14:41.053: INFO: Pod hostpath-client no longer exists Jun 18 06:14:41.054: FAIL: Failed to create client pod: timed out while waiting for pod provisioning-1939/hostpath-client to be running Full Stack Trace k8s.io/kubernetes/test/e2e/framework/volume.TestVolumeClientSlow(...) test/e2e/framework/volume/fixtures.go:589 k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4.1(0xc0039ea1c0) test/e2e/storage/testsuites/provisioning.go:241 +0x269 k8s.io/kubernetes/test/e2e/storage/testsuites.StorageClassTest.TestDynamicProvisioning({{0x7a4f7c8, 0xc002848a80}, 0xc001029680, 0xc0033da000, 0xc0033da1c0, 0xc002332480, {0x0, 0x0}, {0x0, 0x0, ...}, ...}) test/e2e/storage/testsuites/provisioning.go:637 +0x87a k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() test/e2e/storage/testsuites/provisioning.go:243 +0x618 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24d6d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007ba680, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f Jun 18 06:14:41.055: INFO: deleting claim "provisioning-1939"/"pvc-c86tf" Jun 18 06:14:41.156: INFO: deleting initClaim "provisioning-1939"/"pvc-xv2lb" Jun 18 06:14:41.254: INFO: deleting snapshot "provisioning-1939"/"snapshot-zq48h" Jun 18 06:14:41.291: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 readyToUse:false] Jun 18 06:14:41.291: INFO: snapshotContentName snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 Jun 18 06:14:41.368: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 to be deleted Jun 18 06:14:41.406: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:14:43.443: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:14:45.480: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:14:47.517: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:14:49.556: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:14:51.594: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:14:53.631: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:14:55.668: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:14:57.707: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:14:59.744: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:01.781: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:03.826: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:05.862: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:07.899: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:09.935: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:11.972: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:14.008: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:16.045: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:18.082: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:20.119: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:22.156: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:24.194: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:26.232: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:28.269: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:30.305: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:32.342: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:34.380: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:36.417: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:38.457: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:40.493: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:42.531: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:44.567: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:46.607: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:48.644: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:50.681: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:52.718: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:54.756: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:56.793: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:15:58.830: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:00.873: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:02.911: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:04.948: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:06.988: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:09.026: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:11.063: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:13.100: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:15.139: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:17.175: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:19.213: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:21.250: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:23.316: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:25.357: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:27.394: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:29.432: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:31.469: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:33.506: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:35.543: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:37.581: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:39.619: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:41.656: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:43.694: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:45.730: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:47.766: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:49.806: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:51.842: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:53.879: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:55.918: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:57.955: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:16:59.992: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:02.039: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:04.076: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:06.116: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:08.157: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:10.195: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:12.232: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:14.268: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:16.305: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:18.341: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:20.378: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:22.416: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:24.454: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:26.490: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:28.528: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:30.564: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:32.603: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:34.640: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:36.677: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:38.714: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:40.751: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:42.787: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:44.824: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:46.860: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:48.896: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:50.934: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:52.971: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:55.008: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:57.044: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:17:59.085: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:18:01.123: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:18:03.160: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:18:05.197: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:18:07.233: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:18:09.271: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 has been found and is not deleted Jun 18 06:18:11.307: INFO: volumesnapshotcontents snapcontent-9e4008cb-17c9-49ae-b9c8-12ac27a9d836 is not found and has been deleted Jun 18 06:18:11.308: INFO: WaitUntil finished successfully after 3m29.938816706s Jun 18 06:18:11.308: INFO: deleting snapshot class "provisioning-1939x2stl" Jun 18 06:18:11.347: INFO: Waiting up to 5m0s for volumesnapshotclasses provisioning-1939x2stl to be deleted Jun 18 06:18:11.382: INFO: volumesnapshotclasses provisioning-1939x2stl is not found and has been deleted Jun 18 06:18:11.383: INFO: WaitUntil finished successfully after 35.649905ms Jun 18 06:18:11.383: INFO: deleting storage class provisioning-1939lbtck �[1mSTEP�[0m: deleting the test namespace: provisioning-1939 �[1mSTEP�[0m: Waiting for namespaces [provisioning-1939] to vanish �[1mSTEP�[0m: uninstalling csi csi-hostpath driver Jun 18 06:18:17.652: INFO: deleting *v1.ServiceAccount: provisioning-1939-7010/csi-attacher Jun 18 06:18:17.755: INFO: deleting *v1.ClusterRole: external-attacher-runner-provisioning-1939 Jun 18 06:18:17.854: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-provisioning-1939 Jun 18 06:18:17.954: INFO: deleting *v1.Role: provisioning-1939-7010/external-attacher-cfg-provisioning-1939 Jun 18 06:18:18.054: INFO: deleting *v1.RoleBinding: provisioning-1939-7010/csi-attacher-role-cfg Jun 18 06:18:18.155: INFO: deleting *v1.ServiceAccount: provisioning-1939-7010/csi-provisioner Jun 18 06:18:18.254: INFO: deleting *v1.ClusterRole: external-provisioner-runner-provisioning-1939 Jun 18 06:18:18.355: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-provisioning-1939 Jun 18 06:18:18.455: INFO: deleting *v1.Role: provisioning-1939-7010/external-provisioner-cfg-provisioning-1939 Jun 18 06:18:18.555: INFO: deleting *v1.RoleBinding: provisioning-1939-7010/csi-provisioner-role-cfg Jun 18 06:18:18.653: INFO: deleting *v1.ServiceAccount: provisioning-1939-7010/csi-snapshotter Jun 18 06:18:18.754: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-provisioning-1939 Jun 18 06:18:18.853: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-provisioning-1939 Jun 18 06:18:18.955: INFO: deleting *v1.Role: provisioning-1939-7010/external-snapshotter-leaderelection-provisioning-1939 Jun 18 06:18:19.053: INFO: deleting *v1.RoleBinding: provisioning-1939-7010/external-snapshotter-leaderelection Jun 18 06:18:19.154: INFO: deleting *v1.ServiceAccount: provisioning-1939-7010/csi-external-health-monitor-controller Jun 18 06:18:19.254: INFO: deleting *v1.ClusterRole: external-health-monitor-controller-runner-provisioning-1939 Jun 18 06:18:19.355: INFO: deleting *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-provisioning-1939 Jun 18 06:18:19.454: INFO: deleting *v1.Role: provisioning-1939-7010/external-health-monitor-controller-cfg-provisioning-1939 Jun 18 06:18:19.554: INFO: deleting *v1.RoleBinding: provisioning-1939-7010/csi-external-health-monitor-controller-role-cfg Jun 18 06:18:19.653: INFO: deleting *v1.ServiceAccount: provisioning-1939-7010/csi-resizer Jun 18 06:18:19.754: INFO: deleting *v1.ClusterRole: external-resizer-runner-provisioning-1939 Jun 18 06:18:19.854: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-provisioning-1939 Jun 18 06:18:19.954: INFO: deleting *v1.Role: provisioning-1939-7010/external-resizer-cfg-provisioning-1939 Jun 18 06:18:20.054: INFO: deleting *v1.RoleBinding: provisioning-1939-7010/csi-resizer-role-cfg Jun 18 06:18:20.160: INFO: deleting *v1.CSIDriver: csi-hostpath-provisioning-1939 Jun 18 06:18:20.254: INFO: deleting *v1.ServiceAccount: provisioning-1939-7010/csi-hostpathplugin-sa Jun 18 06:18:20.354: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-provisioning-1939 Jun 18 06:18:20.454: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-provisioning-1939 Jun 18 06:18:20.554: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-provisioning-1939 Jun 18 06:18:20.673: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-provisioning-1939 Jun 18 06:18:20.753: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-provisioning-1939 Jun 18 06:18:20.858: INFO: deleting *v1.RoleBinding: provisioning-1939-7010/csi-hostpathplugin-attacher-role Jun 18 06:18:20.955: INFO: deleting *v1.RoleBinding: provisioning-1939-7010/csi-hostpathplugin-health-monitor-controller-role Jun 18 06:18:21.055: INFO: deleting *v1.RoleBinding: provisioning-1939-7010/csi-hostpathplugin-provisioner-role Jun 18 06:18:21.155: INFO: deleting *v1.RoleBinding: provisioning-1939-7010/csi-hostpathplugin-resizer-role Jun 18 06:18:21.255: INFO: deleting *v1.RoleBinding: provisioning-1939-7010/csi-hostpathplugin-snapshotter-role Jun 18 06:18:21.356: INFO: deleting *v1.StatefulSet: provisioning-1939-7010/csi-hostpathplugin Jun 18 06:18:21.454: INFO: deleting *v1.ClusterRoleBinding: psp-csi-hostpath-role-provisioning-1939 �[1mSTEP�[0m: deleting the driver namespace: provisioning-1939-7010 �[1mSTEP�[0m: Waiting for namespaces [provisioning-1939-7010] to vanish [AfterEach] [Testpattern: Dynamic PV (block volmode)] provisioning test/e2e/framework/framework.go:187 Jun 18 06:18:27.692: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\scsi\-hostpath\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sprovisioning\sshould\sprovision\sstorage\swith\ssnapshot\sdata\ssource\s\[Feature\:VolumeSnapshotDataSource\]$'
test/e2e/storage/testsuites/provisioning.go:208 Jun 18 07:13:22.626: VolumeSnapshot snapshot-g4vvp is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 18 07:08:02.831: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource] test/e2e/storage/testsuites/provisioning.go:208 �[1mSTEP�[0m: Building a driver namespace object, basename provisioning-8111 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi-hostpath driver Jun 18 07:08:03.416: INFO: creating *v1.ServiceAccount: provisioning-8111-3307/csi-attacher Jun 18 07:08:03.453: INFO: creating *v1.ClusterRole: external-attacher-runner-provisioning-8111 Jun 18 07:08:03.453: INFO: Define cluster role external-attacher-runner-provisioning-8111 Jun 18 07:08:03.490: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-provisioning-8111 Jun 18 07:08:03.526: INFO: creating *v1.Role: provisioning-8111-3307/external-attacher-cfg-provisioning-8111 Jun 18 07:08:03.562: INFO: creating *v1.RoleBinding: provisioning-8111-3307/csi-attacher-role-cfg Jun 18 07:08:03.599: INFO: creating *v1.ServiceAccount: provisioning-8111-3307/csi-provisioner Jun 18 07:08:03.636: INFO: creating *v1.ClusterRole: external-provisioner-runner-provisioning-8111 Jun 18 07:08:03.636: INFO: Define cluster role external-provisioner-runner-provisioning-8111 Jun 18 07:08:03.675: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-provisioning-8111 Jun 18 07:08:03.711: INFO: creating *v1.Role: provisioning-8111-3307/external-provisioner-cfg-provisioning-8111 Jun 18 07:08:03.748: INFO: creating *v1.RoleBinding: provisioning-8111-3307/csi-provisioner-role-cfg Jun 18 07:08:03.784: INFO: creating *v1.ServiceAccount: provisioning-8111-3307/csi-snapshotter Jun 18 07:08:03.821: INFO: creating *v1.ClusterRole: external-snapshotter-runner-provisioning-8111 Jun 18 07:08:03.821: INFO: Define cluster role external-snapshotter-runner-provisioning-8111 Jun 18 07:08:03.857: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-provisioning-8111 Jun 18 07:08:03.893: INFO: creating *v1.Role: provisioning-8111-3307/external-snapshotter-leaderelection-provisioning-8111 Jun 18 07:08:03.929: INFO: creating *v1.RoleBinding: provisioning-8111-3307/external-snapshotter-leaderelection Jun 18 07:08:03.965: INFO: creating *v1.ServiceAccount: provisioning-8111-3307/csi-external-health-monitor-controller Jun 18 07:08:04.002: INFO: creating *v1.ClusterRole: external-health-monitor-controller-runner-provisioning-8111 Jun 18 07:08:04.002: INFO: Define cluster role external-health-monitor-controller-runner-provisioning-8111 Jun 18 07:08:04.039: INFO: creating *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-provisioning-8111 Jun 18 07:08:04.076: INFO: creating *v1.Role: provisioning-8111-3307/external-health-monitor-controller-cfg-provisioning-8111 Jun 18 07:08:04.112: INFO: creating *v1.RoleBinding: provisioning-8111-3307/csi-external-health-monitor-controller-role-cfg Jun 18 07:08:04.148: INFO: creating *v1.ServiceAccount: provisioning-8111-3307/csi-resizer Jun 18 07:08:04.186: INFO: creating *v1.ClusterRole: external-resizer-runner-provisioning-8111 Jun 18 07:08:04.186: INFO: Define cluster role external-resizer-runner-provisioning-8111 Jun 18 07:08:04.223: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-provisioning-8111 Jun 18 07:08:04.259: INFO: creating *v1.Role: provisioning-8111-3307/external-resizer-cfg-provisioning-8111 Jun 18 07:08:04.295: INFO: creating *v1.RoleBinding: provisioning-8111-3307/csi-resizer-role-cfg Jun 18 07:08:04.333: INFO: creating *v1.CSIDriver: csi-hostpath-provisioning-8111 Jun 18 07:08:04.371: INFO: creating *v1.ServiceAccount: provisioning-8111-3307/csi-hostpathplugin-sa Jun 18 07:08:04.409: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-provisioning-8111 Jun 18 07:08:04.445: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-provisioning-8111 Jun 18 07:08:04.482: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-provisioning-8111 Jun 18 07:08:04.519: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-provisioning-8111 Jun 18 07:08:04.555: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-provisioning-8111 Jun 18 07:08:04.591: INFO: creating *v1.RoleBinding: provisioning-8111-3307/csi-hostpathplugin-attacher-role Jun 18 07:08:04.628: INFO: creating *v1.RoleBinding: provisioning-8111-3307/csi-hostpathplugin-health-monitor-controller-role Jun 18 07:08:04.664: INFO: creating *v1.RoleBinding: provisioning-8111-3307/csi-hostpathplugin-provisioner-role Jun 18 07:08:04.700: INFO: creating *v1.RoleBinding: provisioning-8111-3307/csi-hostpathplugin-resizer-role Jun 18 07:08:04.737: INFO: creating *v1.RoleBinding: provisioning-8111-3307/csi-hostpathplugin-snapshotter-role Jun 18 07:08:04.773: INFO: creating *v1.StatefulSet: provisioning-8111-3307/csi-hostpathplugin Jun 18 07:08:04.816: INFO: creating *v1.ClusterRoleBinding: psp-csi-hostpath-role-provisioning-8111 Jun 18 07:08:04.904: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Jun 18 07:08:04.904: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Jun 18 07:08:04.904: INFO: In creating storage class object and pvc objects for driver - sc: &StorageClass{ObjectMeta:{provisioning-8111jdsnx 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Provisioner:csi-hostpath-provisioning-8111,Parameters:map[string]string{},ReclaimPolicy:nil,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},}, pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-8111 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1048576 0} {<nil>} 1Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-8111jdsnx,VolumeMode:nil,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},}, src-pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-8111 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1048576 0} {<nil>} 1Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-8111jdsnx,VolumeMode:nil,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: Creating a StorageClass �[1mSTEP�[0m: [Initialize dataSource]creating a initClaim �[1mSTEP�[0m: starting hostpath-injector Jun 18 07:08:05.131: INFO: Waiting up to 5m0s for pod "hostpath-injector" in namespace "provisioning-8111" to be "running" Jun 18 07:08:05.166: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 35.064269ms Jun 18 07:08:07.207: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.076053005s Jun 18 07:08:09.204: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.073413316s Jun 18 07:08:11.203: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.072068233s Jun 18 07:08:13.202: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.0715678s Jun 18 07:08:15.202: INFO: Pod "hostpath-injector": Phase="Running", Reason="", readiness=true. Elapsed: 10.071580377s Jun 18 07:08:15.202: INFO: Pod "hostpath-injector" satisfied condition "running" �[1mSTEP�[0m: Writing text file contents in the container. Jun 18 07:08:15.202: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.83.44.136 --kubeconfig=/workspace/.kube/config --namespace=provisioning-8111 exec hostpath-injector --namespace=provisioning-8111 -- /bin/sh -c echo 'Hello from namespace provisioning-8111' > /opt/0/index.html' Jun 18 07:08:15.741: INFO: stderr: "" Jun 18 07:08:15.741: INFO: stdout: "" �[1mSTEP�[0m: Checking that text file contents are perfect. Jun 18 07:08:15.741: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.83.44.136 --kubeconfig=/workspace/.kube/config --namespace=provisioning-8111 exec hostpath-injector --namespace=provisioning-8111 -- cat /opt/0/index.html' Jun 18 07:08:16.221: INFO: stderr: "" Jun 18 07:08:16.221: INFO: stdout: "Hello from namespace provisioning-8111\n" Jun 18 07:08:16.221: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:provisioning-8111 PodName:hostpath-injector ContainerName:hostpath-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 18 07:08:16.221: INFO: >>> kubeConfig: /workspace/.kube/config Jun 18 07:08:16.222: INFO: ExecWithOptions: Clientset creation Jun 18 07:08:16.222: INFO: ExecWithOptions: execute(POST https://34.83.44.136/api/v1/namespaces/provisioning-8111/pods/hostpath-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=hostpath-injector&container=hostpath-injector&stderr=true&stdout=true) Jun 18 07:08:16.499: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:provisioning-8111 PodName:hostpath-injector ContainerName:hostpath-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 18 07:08:16.499: INFO: >>> kubeConfig: /workspace/.kube/config Jun 18 07:08:16.500: INFO: ExecWithOptions: Clientset creation Jun 18 07:08:16.500: INFO: ExecWithOptions: execute(POST https://34.83.44.136/api/v1/namespaces/provisioning-8111/pods/hostpath-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=hostpath-injector&container=hostpath-injector&stderr=true&stdout=true) �[1mSTEP�[0m: Deleting pod hostpath-injector in namespace provisioning-8111 Jun 18 07:08:16.813: INFO: Waiting for pod hostpath-injector to disappear Jun 18 07:08:16.848: INFO: Pod hostpath-injector still exists Jun 18 07:08:18.849: INFO: Waiting for pod hostpath-injector to disappear Jun 18 07:08:18.884: INFO: Pod hostpath-injector still exists Jun 18 07:08:20.849: INFO: Waiting for pod hostpath-injector to disappear Jun 18 07:08:20.884: INFO: Pod hostpath-injector no longer exists �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 18 07:08:20.999: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-g4vvp to become ready Jun 18 07:08:21.054: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:23.091: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:25.128: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:27.164: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:29.201: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:31.238: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:33.276: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:35.313: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:37.350: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:39.386: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:41.423: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:43.460: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:45.498: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:47.536: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:49.572: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:51.610: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:53.646: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:55.683: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:57.720: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:08:59.757: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:01.794: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:03.831: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:05.868: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:07.904: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:09.942: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:11.978: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:14.020: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:16.057: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:18.093: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:20.129: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:22.175: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:24.222: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:26.258: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:28.296: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:30.333: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:32.371: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:34.408: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:36.445: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:38.481: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:40.517: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:42.555: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:44.592: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:46.629: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:48.666: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:50.703: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:52.739: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:54.776: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:56.812: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:09:58.850: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:00.888: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:02.925: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:04.962: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:07.048: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:09.085: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:11.123: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:13.160: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:15.197: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:17.235: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:19.273: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:21.310: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:23.348: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:25.385: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:27.422: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:29.461: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:31.498: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:33.535: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:35.572: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:37.614: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:39.651: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:41.689: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:43.725: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:45.762: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:47.800: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:49.836: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:51.874: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:53.911: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:55.948: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:10:57.984: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:00.022: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:02.059: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:04.096: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:06.140: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:08.176: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:10.214: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:12.251: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:14.289: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:16.326: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:18.364: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:20.402: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:22.440: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:24.478: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:26.514: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:28.551: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:30.588: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:32.624: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:34.661: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:36.698: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:38.735: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:40.772: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:42.808: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:44.845: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:46.882: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:48.919: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:50.955: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:52.991: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:55.029: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:57.066: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:11:59.104: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:01.142: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:03.180: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:05.217: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:07.283: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:09.323: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:11.360: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:13.398: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:15.437: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:17.475: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:19.513: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:21.550: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:23.587: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:25.626: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:27.664: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:29.700: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:31.738: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:33.775: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:35.811: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:37.849: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:39.885: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:41.923: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:43.959: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:45.995: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:48.032: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:50.069: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:52.106: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:54.144: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:56.180: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:12:58.216: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:00.253: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:02.290: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:04.328: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:06.365: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:08.402: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:10.439: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:12.476: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:14.514: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:16.552: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:18.588: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:20.625: INFO: VolumeSnapshot snapshot-g4vvp found but is not ready. Jun 18 07:13:22.625: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 18 07:13:22.626: INFO: Unexpected error: <*errors.errorString | 0xc002322310>: { s: "VolumeSnapshot snapshot-g4vvp is not ready within 5m0s", } Jun 18 07:13:22.626: FAIL: VolumeSnapshot snapshot-g4vvp is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc0036661a0?}, 0xc003666300) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7fdc384f5248, 0xc0011a6c00}, 0xc004b632c0, {{0x7182fb1, 0x17}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage/testsuites.prepareSnapshotDataSourceForProvisioning(_, {{0xc002649c38, 0x11}, {0x713b04a, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...) test/e2e/storage/testsuites/provisioning.go:1090 +0x41f k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() test/e2e/storage/testsuites/provisioning.go:227 +0x485 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24d6d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007ba680, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: creating claim=&PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-8111 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1048576 0} {<nil>} 1Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-8111jdsnx,VolumeMode:nil,DataSource:&TypedLocalObjectReference{APIGroup:*snapshot.storage.k8s.io,Kind:VolumeSnapshot,Name:snapshot-g4vvp,},DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: checking whether the created volume has the pre-populated data �[1mSTEP�[0m: starting hostpath-client Jun 18 07:13:22.778: INFO: Waiting up to 15m0s for pod "hostpath-client" in namespace "provisioning-8111" to be "running" Jun 18 07:13:22.813: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 35.056695ms Jun 18 07:13:24.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071939878s Jun 18 07:13:26.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4.071665599s Jun 18 07:13:28.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6.071269327s Jun 18 07:13:30.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8.07177332s Jun 18 07:13:32.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10.072475519s Jun 18 07:13:34.857: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12.078831225s Jun 18 07:13:36.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14.072017851s Jun 18 07:13:38.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 16.072155989s Jun 18 07:13:40.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 18.07259823s Jun 18 07:13:42.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 20.072170198s Jun 18 07:13:44.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 22.072462383s Jun 18 07:13:46.849: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 24.070905813s Jun 18 07:13:48.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 26.071911393s Jun 18 07:13:50.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 28.072259102s Jun 18 07:13:52.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 30.071590653s Jun 18 07:13:54.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 32.072347745s Jun 18 07:13:56.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 34.071307937s Jun 18 07:13:58.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 36.072850588s Jun 18 07:14:00.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 38.072960833s Jun 18 07:14:02.857: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 40.078947783s Jun 18 07:14:04.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 42.071472907s Jun 18 07:14:06.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 44.072220043s Jun 18 07:14:08.854: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 46.075220508s Jun 18 07:14:10.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 48.072110889s Jun 18 07:14:12.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 50.072119127s Jun 18 07:14:14.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 52.073142809s Jun 18 07:14:16.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 54.073026321s Jun 18 07:14:18.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 56.072922206s Jun 18 07:14:20.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 58.072628907s Jun 18 07:14:22.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.072932557s Jun 18 07:14:24.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.072619848s Jun 18 07:14:26.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.071679857s Jun 18 07:14:28.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.072969329s Jun 18 07:14:30.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.072388741s Jun 18 07:14:32.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.072561942s Jun 18 07:14:34.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.072022751s Jun 18 07:14:36.852: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.073217588s Jun 18 07:14:38.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.072922427s Jun 18 07:14:40.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.072155517s Jun 18 07:14:42.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.072028793s Jun 18 07:14:44.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.072090942s Jun 18 07:14:46.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.072596573s Jun 18 07:14:48.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.07209911s Jun 18 07:14:50.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.071668189s Jun 18 07:14:52.854: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.075219205s Jun 18 07:14:54.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.072447937s Jun 18 07:14:56.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.071779327s Jun 18 07:14:58.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.072649785s Jun 18 07:15:00.852: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.07367548s Jun 18 07:15:02.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.072613357s Jun 18 07:15:04.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.071534507s Jun 18 07:15:06.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.072512331s Jun 18 07:15:08.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.072242345s Jun 18 07:15:10.900: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.121969722s Jun 18 07:15:12.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.071769501s Jun 18 07:15:14.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.071914877s Jun 18 07:15:16.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.071190057s Jun 18 07:15:18.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.07197265s Jun 18 07:15:20.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.071577685s Jun 18 07:15:22.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.071413234s Jun 18 07:15:24.849: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.071117623s Jun 18 07:15:26.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.072150631s Jun 18 07:15:28.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.072363656s Jun 18 07:15:30.849: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.071093185s Jun 18 07:15:32.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.072199992s Jun 18 07:15:34.873: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.094495908s Jun 18 07:15:36.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.072320816s Jun 18 07:15:38.849: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.070850121s Jun 18 07:15:40.851: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.072420484s Jun 18 07:15:42.849: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.071179508s Jun 18 07:15:44.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.071243341s Jun 18 07:15:46.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.132736765s Jun 18 07:15:48.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.132877535s Jun 18 07:15:50.918: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.139611886s Jun 18 07:15:52.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.132533521s Jun 18 07:15:54.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.132994256s Jun 18 07:15:56.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.132285523s Jun 18 07:15:58.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.082503251s Jun 18 07:16:00.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.132884762s Jun 18 07:16:02.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.13250961s Jun 18 07:16:04.913: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.134634204s Jun 18 07:16:06.862: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.083504548s Jun 18 07:16:08.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.132918314s Jun 18 07:16:10.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.133305459s Jun 18 07:16:12.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.133024067s Jun 18 07:16:14.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.132880023s Jun 18 07:16:16.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.132309277s Jun 18 07:16:18.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.133653053s Jun 18 07:16:20.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.133561241s Jun 18 07:16:22.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.133226126s Jun 18 07:16:24.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.133537676s Jun 18 07:16:26.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.132500132s Jun 18 07:16:28.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.132810982s Jun 18 07:16:30.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.132945053s Jun 18 07:16:32.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.132488173s Jun 18 07:16:34.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.133198992s Jun 18 07:16:36.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.132049428s Jun 18 07:16:38.913: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.134496216s Jun 18 07:16:40.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.132858997s Jun 18 07:16:42.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.132458346s Jun 18 07:16:44.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.132204667s Jun 18 07:16:46.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.133348763s Jun 18 07:16:48.860: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.081995707s Jun 18 07:16:50.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.132987231s Jun 18 07:16:52.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.131822632s Jun 18 07:16:54.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.132525002s Jun 18 07:16:56.918: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.139528532s Jun 18 07:16:58.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.132677599s Jun 18 07:17:00.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.132940368s Jun 18 07:17:02.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.132754895s Jun 18 07:17:04.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.132592835s Jun 18 07:17:06.865: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.087150225s Jun 18 07:17:08.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.132590724s Jun 18 07:17:10.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.133400777s Jun 18 07:17:12.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.132286631s Jun 18 07:17:14.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.083167524s Jun 18 07:17:16.914: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.135220255s Jun 18 07:17:18.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.133211944s Jun 18 07:17:20.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.132946537s Jun 18 07:17:22.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.132838567s Jun 18 07:17:24.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.131986938s Jun 18 07:17:26.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.132854863s Jun 18 07:17:28.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.133432178s Jun 18 07:17:30.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.132851772s Jun 18 07:17:32.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.132406684s Jun 18 07:17:34.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.132416637s Jun 18 07:17:36.923: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.144210631s Jun 18 07:17:38.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.133096018s Jun 18 07:17:40.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.133220334s Jun 18 07:17:42.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.132383182s Jun 18 07:17:44.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.132804732s Jun 18 07:17:46.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.133325505s Jun 18 07:17:48.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.132738005s Jun 18 07:17:50.863: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.084220756s Jun 18 07:17:52.863: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.084189538s Jun 18 07:17:54.863: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.084334248s Jun 18 07:17:56.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.132906691s Jun 18 07:17:58.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.08247073s Jun 18 07:18:00.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.133501465s Jun 18 07:18:02.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.132858021s Jun 18 07:18:04.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.082937805s Jun 18 07:18:06.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.082292539s Jun 18 07:18:08.865: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.08655337s Jun 18 07:18:10.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.133614598s Jun 18 07:18:12.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.132134742s Jun 18 07:18:14.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.133170452s Jun 18 07:18:16.862: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.083918119s Jun 18 07:18:18.921: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.143070529s Jun 18 07:18:20.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.132902961s Jun 18 07:18:22.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.133471436s Jun 18 07:18:24.913: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.135011894s Jun 18 07:18:26.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.133403998s Jun 18 07:18:28.977: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.198631741s Jun 18 07:18:30.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.133555582s Jun 18 07:18:32.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.133106486s Jun 18 07:18:34.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.133092859s Jun 18 07:18:36.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.13264863s Jun 18 07:18:38.914: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.135711798s Jun 18 07:18:40.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.132701405s Jun 18 07:18:42.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.132034416s Jun 18 07:18:44.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.132659566s Jun 18 07:18:46.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.134064014s Jun 18 07:18:48.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.082590762s Jun 18 07:18:50.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.132274458s Jun 18 07:18:52.913: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.134276098s Jun 18 07:18:54.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.132204227s Jun 18 07:18:56.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m34.132235828s Jun 18 07:18:58.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m36.132841187s Jun 18 07:19:00.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m38.133283059s Jun 18 07:19:02.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m40.132321245s Jun 18 07:19:04.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m42.132241496s Jun 18 07:19:06.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m44.132221561s Jun 18 07:19:08.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m46.132921937s Jun 18 07:19:10.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m48.133387886s Jun 18 07:19:12.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.132614607s Jun 18 07:19:14.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.083108646s Jun 18 07:19:16.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.133153821s Jun 18 07:19:18.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.132179326s Jun 18 07:19:20.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.132966333s Jun 18 07:19:22.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.132008681s Jun 18 07:19:24.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.132570014s Jun 18 07:19:26.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.133559476s Jun 18 07:19:28.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.13297953s Jun 18 07:19:30.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.132257525s Jun 18 07:19:32.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.133038341s Jun 18 07:19:34.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.133298353s Jun 18 07:19:36.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.132867985s Jun 18 07:19:38.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.133117982s Jun 18 07:19:40.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.133226746s Jun 18 07:19:42.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.132855241s Jun 18 07:19:44.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.131584524s Jun 18 07:19:46.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.133218921s Jun 18 07:19:48.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.132667472s Jun 18 07:19:50.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.083052227s Jun 18 07:19:52.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.132750289s Jun 18 07:19:54.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.13401576s Jun 18 07:19:56.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.133518545s Jun 18 07:19:58.860: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.082025631s Jun 18 07:20:00.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.13268185s Jun 18 07:20:02.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.082419518s Jun 18 07:20:04.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.132963626s Jun 18 07:20:06.966: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m44.187876682s Jun 18 07:20:08.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m46.132682072s Jun 18 07:20:10.949: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m48.170998607s Jun 18 07:20:12.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m50.132586441s Jun 18 07:20:14.915: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m52.136825249s Jun 18 07:20:16.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.082973407s Jun 18 07:20:18.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.132666403s Jun 18 07:20:20.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.133103774s Jun 18 07:20:22.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.133225718s Jun 18 07:20:24.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.133658587s Jun 18 07:20:26.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.133939474s Jun 18 07:20:28.862: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.08415305s Jun 18 07:20:30.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.13298981s Jun 18 07:20:32.913: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.134227459s Jun 18 07:20:34.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.132143658s Jun 18 07:20:36.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.132833763s Jun 18 07:20:38.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m16.133511378s Jun 18 07:20:40.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m18.132537959s Jun 18 07:20:42.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m20.133017535s Jun 18 07:20:44.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m22.083028254s Jun 18 07:20:46.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m24.132970897s Jun 18 07:20:48.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m26.132377039s Jun 18 07:20:50.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m28.13320429s Jun 18 07:20:52.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m30.132964679s Jun 18 07:20:54.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m32.133536419s Jun 18 07:20:56.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m34.132135791s Jun 18 07:20:58.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m36.13293046s Jun 18 07:21:00.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m38.133269584s Jun 18 07:21:02.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m40.133311259s Jun 18 07:21:04.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m42.132975624s Jun 18 07:21:06.947: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m44.168568431s Jun 18 07:21:08.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m46.132181729s Jun 18 07:21:10.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.133061666s Jun 18 07:21:12.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.133469593s Jun 18 07:21:14.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.133061275s Jun 18 07:21:16.862: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.084083496s Jun 18 07:21:18.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.132726296s Jun 18 07:21:20.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.133230602s Jun 18 07:21:22.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.133250954s Jun 18 07:21:24.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m2.132088365s Jun 18 07:21:26.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m4.132237962s Jun 18 07:21:28.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m6.132829598s Jun 18 07:21:30.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m8.133202093s Jun 18 07:21:32.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m10.13267249s Jun 18 07:21:34.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m12.13284617s Jun 18 07:21:36.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m14.132760541s Jun 18 07:21:38.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m16.132575391s Jun 18 07:21:40.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m18.13339039s Jun 18 07:21:42.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m20.082438586s Jun 18 07:21:44.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m22.132442862s Jun 18 07:21:46.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m24.132471902s Jun 18 07:21:48.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m26.132793294s Jun 18 07:21:50.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m28.133046689s Jun 18 07:21:52.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m30.132597075s Jun 18 07:21:54.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.13207164s Jun 18 07:21:56.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.133173749s Jun 18 07:21:58.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.133467695s Jun 18 07:22:00.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.132683291s Jun 18 07:22:02.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.13320763s Jun 18 07:22:04.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.133361795s Jun 18 07:22:06.862: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.083875734s Jun 18 07:22:08.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m46.132944306s Jun 18 07:22:10.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m48.133168084s Jun 18 07:22:12.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m50.132704856s Jun 18 07:22:14.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m52.132527552s Jun 18 07:22:16.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m54.132548034s Jun 18 07:22:18.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m56.132754271s Jun 18 07:22:20.860: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m58.082046469s Jun 18 07:22:22.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m0.133068569s Jun 18 07:22:24.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m2.132981943s Jun 18 07:22:26.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m4.133355972s Jun 18 07:22:28.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m6.133019793s Jun 18 07:22:30.871: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m8.092808003s Jun 18 07:22:32.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m10.133178418s Jun 18 07:22:34.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m12.132413485s Jun 18 07:22:36.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m14.133022738s Jun 18 07:22:38.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m16.133102553s Jun 18 07:22:40.926: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m18.147982432s Jun 18 07:22:42.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m20.133430995s Jun 18 07:22:44.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m22.133358241s Jun 18 07:22:46.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m24.133055056s Jun 18 07:22:48.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m26.133043412s Jun 18 07:22:50.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m28.132906006s Jun 18 07:22:52.913: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m30.134386244s Jun 18 07:22:54.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m32.132794938s Jun 18 07:22:56.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m34.132196746s Jun 18 07:22:58.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m36.133063345s Jun 18 07:23:00.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m38.133714145s Jun 18 07:23:02.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m40.132463714s Jun 18 07:23:04.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m42.132997179s Jun 18 07:23:06.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m44.082623359s Jun 18 07:23:08.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m46.13217348s Jun 18 07:23:10.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m48.132654012s Jun 18 07:23:12.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m50.132632344s Jun 18 07:23:14.876: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m52.09817206s Jun 18 07:23:16.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m54.132627399s Jun 18 07:23:18.913: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m56.135165337s Jun 18 07:23:20.914: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m58.13541078s Jun 18 07:23:22.914: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m0.135739838s Jun 18 07:23:24.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m2.133168645s Jun 18 07:23:26.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m4.133030586s Jun 18 07:23:28.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m6.133255103s Jun 18 07:23:30.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m8.133702515s Jun 18 07:23:32.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m10.132333893s Jun 18 07:23:34.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m12.133532011s Jun 18 07:23:36.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m14.132941011s Jun 18 07:23:38.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m16.133340144s Jun 18 07:23:40.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m18.132458476s Jun 18 07:23:42.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m20.132955168s Jun 18 07:23:44.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m22.132336648s Jun 18 07:23:46.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m24.131858649s Jun 18 07:23:48.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m26.132916894s Jun 18 07:23:50.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m28.132817232s Jun 18 07:23:52.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m30.13218238s Jun 18 07:23:54.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m32.132519661s Jun 18 07:23:56.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m34.132234145s Jun 18 07:23:58.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m36.134020842s Jun 18 07:24:00.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m38.133161884s Jun 18 07:24:02.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m40.133081496s Jun 18 07:24:04.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m42.133432709s Jun 18 07:24:06.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m44.132484406s Jun 18 07:24:08.862: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m46.083613188s Jun 18 07:24:10.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m48.133039761s Jun 18 07:24:12.909: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m50.13021824s Jun 18 07:24:14.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m52.132860459s Jun 18 07:24:16.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m54.132679842s Jun 18 07:24:18.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m56.133028871s Jun 18 07:24:20.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m58.132320343s Jun 18 07:24:22.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m0.132491016s Jun 18 07:24:24.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m2.132575331s Jun 18 07:24:26.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m4.133312599s Jun 18 07:24:28.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m6.133528575s Jun 18 07:24:30.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m8.132831309s Jun 18 07:24:32.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m10.132349214s Jun 18 07:24:34.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m12.13307967s Jun 18 07:24:36.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m14.132304586s Jun 18 07:24:38.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m16.132263123s Jun 18 07:24:40.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m18.133029828s Jun 18 07:24:42.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m20.132354196s Jun 18 07:24:44.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m22.133152459s Jun 18 07:24:46.905: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m24.126619178s Jun 18 07:24:48.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m26.13263091s Jun 18 07:24:50.913: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m28.13420557s Jun 18 07:24:52.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m30.132729325s Jun 18 07:24:54.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m32.132991662s Jun 18 07:24:56.885: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m34.106266906s Jun 18 07:24:58.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m36.133168589s Jun 18 07:25:00.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m38.132737312s Jun 18 07:25:02.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m40.133642425s Jun 18 07:25:04.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m42.133054169s Jun 18 07:25:06.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m44.133055519s Jun 18 07:25:08.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m46.132252984s Jun 18 07:25:10.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m48.1331782s Jun 18 07:25:12.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m50.133266598s Jun 18 07:25:14.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m52.132193759s Jun 18 07:25:16.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m54.13293302s Jun 18 07:25:18.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m56.133453404s Jun 18 07:25:20.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m58.08252959s Jun 18 07:25:22.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m0.132661041s Jun 18 07:25:24.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m2.131897548s Jun 18 07:25:26.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m4.133162632s Jun 18 07:25:28.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m6.132426532s Jun 18 07:25:30.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m8.132402212s Jun 18 07:25:32.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m10.132210053s Jun 18 07:25:34.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m12.132341152s Jun 18 07:25:36.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m14.133028203s Jun 18 07:25:38.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m16.132474772s Jun 18 07:25:40.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m18.132927777s Jun 18 07:25:42.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m20.133020687s Jun 18 07:25:44.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m22.133027983s Jun 18 07:25:46.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m24.132884237s Jun 18 07:25:48.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m26.132345101s Jun 18 07:25:50.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m28.132815787s Jun 18 07:25:52.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m30.132774629s Jun 18 07:25:54.850: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m32.071266387s Jun 18 07:25:56.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m34.132962444s Jun 18 07:25:58.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m36.132425306s Jun 18 07:26:00.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m38.133493296s Jun 18 07:26:02.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m40.133289681s Jun 18 07:26:04.862: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m42.083341731s Jun 18 07:26:06.862: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m44.08341632s Jun 18 07:26:08.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m46.133068334s Jun 18 07:26:10.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m48.13304196s Jun 18 07:26:12.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m50.132993374s Jun 18 07:26:14.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m52.083181374s Jun 18 07:26:16.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m54.133499648s Jun 18 07:26:18.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m56.132629883s Jun 18 07:26:20.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m58.132708078s Jun 18 07:26:22.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m0.131659663s Jun 18 07:26:24.925: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m2.146502278s Jun 18 07:26:26.916: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m4.138060794s Jun 18 07:26:28.929: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m6.15114357s Jun 18 07:26:30.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m8.134120268s Jun 18 07:26:32.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m10.13220364s Jun 18 07:26:34.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m12.132636791s Jun 18 07:26:36.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m14.132730276s Jun 18 07:26:38.891: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m16.112330797s Jun 18 07:26:40.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m18.13252438s Jun 18 07:26:42.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m20.133078218s Jun 18 07:26:44.910: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m22.13203496s Jun 18 07:26:46.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m24.132219218s Jun 18 07:26:48.926: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m26.148091764s Jun 18 07:26:50.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m28.132700345s Jun 18 07:26:52.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m30.083072617s Jun 18 07:26:54.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m32.133025181s Jun 18 07:26:56.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m34.132315722s Jun 18 07:26:58.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m36.133059429s Jun 18 07:27:00.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m38.133467577s Jun 18 07:27:02.862: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m40.083202625s Jun 18 07:27:04.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m42.132425439s Jun 18 07:27:06.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m44.082910347s Jun 18 07:27:08.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m46.132626064s Jun 18 07:27:10.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m48.132779709s Jun 18 07:27:12.849: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m50.071121681s Jun 18 07:27:14.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m52.132720174s Jun 18 07:27:16.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m54.13352s Jun 18 07:27:18.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m56.133058542s Jun 18 07:27:20.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m58.132777966s Jun 18 07:27:22.930: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m0.151651862s Jun 18 07:27:24.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m2.132475357s Jun 18 07:27:26.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m4.132923347s Jun 18 07:27:28.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m6.13305187s Jun 18 07:27:30.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m8.132815489s Jun 18 07:27:32.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m10.133350434s Jun 18 07:27:34.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m12.132249756s Jun 18 07:27:36.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m14.132796904s Jun 18 07:27:38.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m16.133255144s Jun 18 07:27:40.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m18.133385031s Jun 18 07:27:42.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m20.132971791s Jun 18 07:27:44.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m22.132715025s Jun 18 07:27:46.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m24.132554583s Jun 18 07:27:48.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m26.132893653s Jun 18 07:27:50.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m28.132856301s Jun 18 07:27:52.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m30.133288139s Jun 18 07:27:54.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m32.13356985s Jun 18 07:27:56.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m34.1321958s Jun 18 07:27:58.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m36.132825478s Jun 18 07:28:00.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m38.132825253s Jun 18 07:28:02.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m40.082369431s Jun 18 07:28:04.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m42.133389013s Jun 18 07:28:06.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m44.132307096s Jun 18 07:28:08.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m46.132788765s Jun 18 07:28:10.861: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m48.082256184s Jun 18 07:28:12.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m50.133019449s Jun 18 07:28:14.912: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m52.133251758s Jun 18 07:28:16.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m54.133123394s Jun 18 07:28:18.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m56.133159686s Jun 18 07:28:20.925: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m58.146955351s Jun 18 07:28:22.911: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.133079236s Jun 18 07:28:23.011: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.232235137s �[1mSTEP�[0m: Deleting pod hostpath-client in namespace provisioning-8111 Jun 18 07:28:23.134: INFO: Waiting for pod hostpath-client to disappear Jun 18 07:28:23.211: INFO: Pod hostpath-client no longer exists Jun 18 07:28:23.211: FAIL: Failed to create client pod: timed out while waiting for pod provisioning-8111/hostpath-client to be running Full Stack Trace k8s.io/kubernetes/test/e2e/framework/volume.TestVolumeClientSlow(...) test/e2e/framework/volume/fixtures.go:589 k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4.1(0xc003eb41c0) test/e2e/storage/testsuites/provisioning.go:241 +0x269 k8s.io/kubernetes/test/e2e/storage/testsuites.StorageClassTest.TestDynamicProvisioning({{0x7a4f7c8, 0xc002849500}, 0xc001029480, 0xc003eb4540, 0xc003eb4700, 0xc002332a80, {0x0, 0x0}, {0x0, 0x0, ...}, ...}) test/e2e/storage/testsuites/provisioning.go:637 +0x87a k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() test/e2e/storage/testsuites/provisioning.go:243 +0x618 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24d6d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007ba680, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f Jun 18 07:28:23.212: INFO: deleting claim "provisioning-8111"/"pvc-lvsbb" Jun 18 07:28:23.346: INFO: deleting initClaim "provisioning-8111"/"pvc-2mjc8" Jun 18 07:28:23.414: INFO: deleting snapshot "provisioning-8111"/"snapshot-g4vvp" Jun 18 07:28:23.450: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 readyToUse:false] Jun 18 07:28:23.450: INFO: snapshotContentName snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 Jun 18 07:28:23.526: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 to be deleted Jun 18 07:28:23.563: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:25.601: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:27.638: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:29.675: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:31.714: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:33.751: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:35.793: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:37.829: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:39.871: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:41.908: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:43.945: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:45.982: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:48.018: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:50.055: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:52.092: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:54.129: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:56.171: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:28:58.209: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:00.247: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:02.287: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:04.331: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:06.369: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:08.407: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:10.446: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:12.483: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:14.523: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:16.567: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:18.607: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:20.655: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:22.691: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:24.728: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:26.779: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:28.818: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:30.854: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:32.893: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:34.931: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:36.970: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:39.007: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:41.043: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:43.079: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:45.117: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:47.159: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:49.199: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:51.239: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:53.283: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:55.323: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:57.367: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:29:59.407: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:01.448: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:03.487: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:05.541: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:07.583: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:09.618: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:11.657: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:13.699: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:15.737: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:17.775: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:19.815: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:21.859: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:23.899: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:25.939: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:27.979: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:30.019: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:32.063: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:34.100: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:36.139: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:38.182: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:40.219: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:42.256: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:44.297: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:46.337: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:48.375: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:50.418: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:52.463: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:54.535: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:56.575: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:30:58.618: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:00.659: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:02.702: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:04.747: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:06.790: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:08.829: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:10.874: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:12.912: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:14.949: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:16.987: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:19.023: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:21.063: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:23.100: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:25.138: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:27.179: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:29.217: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:31.259: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:33.363: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:35.407: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:37.450: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:39.489: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:41.527: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:43.567: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:45.606: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:47.647: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:49.687: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:51.725: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 has been found and is not deleted Jun 18 07:31:53.767: INFO: volumesnapshotcontents snapcontent-4a98b206-ef90-4c59-8236-5b5c2d220f87 is not found and has been deleted Jun 18 07:31:53.767: INFO: WaitUntil finished successfully after 3m30.241480383s Jun 18 07:31:53.767: INFO: deleting snapshot class "provisioning-8111jrbf2" Jun 18 07:31:53.806: INFO: Waiting up to 5m0s for volumesnapshotclasses provisioning-8111jrbf2 to be deleted Jun 18 07:31:53.841: INFO: volumesnapshotclasses provisioning-8111jrbf2 is not found and has been deleted Jun 18 07:31:53.842: INFO: WaitUntil finished successfully after 35.587554ms Jun 18 07:31:53.843: INFO: deleting storage class provisioning-8111jdsnx �[1mSTEP�[0m: deleting the test namespace: provisioning-8111 �[1mSTEP�[0m: Waiting for namespaces [provisioning-8111] to vanish �[1mSTEP�[0m: uninstalling csi csi-hostpath driver Jun 18 07:32:00.115: INFO: deleting *v1.ServiceAccount: provisioning-8111-3307/csi-attacher Jun 18 07:32:00.214: INFO: deleting *v1.ClusterRole: external-attacher-runner-provisioning-8111 Jun 18 07:32:00.317: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-provisioning-8111 Jun 18 07:32:00.415: INFO: deleting *v1.Role: provisioning-8111-3307/external-attacher-cfg-provisioning-8111 Jun 18 07:32:00.514: INFO: deleting *v1.RoleBinding: provisioning-8111-3307/csi-attacher-role-cfg Jun 18 07:32:00.613: INFO: deleting *v1.ServiceAccount: provisioning-8111-3307/csi-provisioner Jun 18 07:32:00.718: INFO: deleting *v1.ClusterRole: external-provisioner-runner-provisioning-8111 Jun 18 07:32:00.820: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-provisioning-8111 Jun 18 07:32:00.921: INFO: deleting *v1.Role: provisioning-8111-3307/external-provisioner-cfg-provisioning-8111 Jun 18 07:32:01.015: INFO: deleting *v1.RoleBinding: provisioning-8111-3307/csi-provisioner-role-cfg Jun 18 07:32:01.117: INFO: deleting *v1.ServiceAccount: provisioning-8111-3307/csi-snapshotter Jun 18 07:32:01.219: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-provisioning-8111 Jun 18 07:32:01.316: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-provisioning-8111 Jun 18 07:32:01.417: INFO: deleting *v1.Role: provisioning-8111-3307/external-snapshotter-leaderelection-provisioning-8111 Jun 18 07:32:01.517: INFO: deleting *v1.RoleBinding: provisioning-8111-3307/external-snapshotter-leaderelection Jun 18 07:32:01.614: INFO: deleting *v1.ServiceAccount: provisioning-8111-3307/csi-external-health-monitor-controller Jun 18 07:32:01.715: INFO: deleting *v1.ClusterRole: external-health-monitor-controller-runner-provisioning-8111 Jun 18 07:32:01.822: INFO: deleting *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-provisioning-8111 Jun 18 07:32:01.913: INFO: deleting *v1.Role: provisioning-8111-3307/external-health-monitor-controller-cfg-provisioning-8111 Jun 18 07:32:02.013: INFO: deleting *v1.RoleBinding: provisioning-8111-3307/csi-external-health-monitor-controller-role-cfg Jun 18 07:32:02.117: INFO: deleting *v1.ServiceAccount: provisioning-8111-3307/csi-resizer Jun 18 07:32:02.215: INFO: deleting *v1.ClusterRole: external-resizer-runner-provisioning-8111 Jun 18 07:32:02.314: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-provisioning-8111 Jun 18 07:32:02.420: INFO: deleting *v1.Role: provisioning-8111-3307/external-resizer-cfg-provisioning-8111 Jun 18 07:32:02.533: INFO: deleting *v1.RoleBinding: provisioning-8111-3307/csi-resizer-role-cfg Jun 18 07:32:02.618: INFO: deleting *v1.CSIDriver: csi-hostpath-provisioning-8111 Jun 18 07:32:02.721: INFO: deleting *v1.ServiceAccount: provisioning-8111-3307/csi-hostpathplugin-sa Jun 18 07:32:02.817: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-provisioning-8111 Jun 18 07:32:02.914: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-provisioning-8111 Jun 18 07:32:03.021: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-provisioning-8111 Jun 18 07:32:03.116: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-provisioning-8111 Jun 18 07:32:03.214: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-provisioning-8111 Jun 18 07:32:03.323: INFO: deleting *v1.RoleBinding: provisioning-8111-3307/csi-hostpathplugin-attacher-role Jun 18 07:32:03.416: INFO: deleting *v1.RoleBinding: provisioning-8111-3307/csi-hostpathplugin-health-monitor-controller-role Jun 18 07:32:03.518: INFO: deleting *v1.RoleBinding: provisioning-8111-3307/csi-hostpathplugin-provisioner-role Jun 18 07:32:03.619: INFO: deleting *v1.RoleBinding: provisioning-8111-3307/csi-hostpathplugin-resizer-role Jun 18 07:32:03.719: INFO: deleting *v1.RoleBinding: provisioning-8111-3307/csi-hostpathplugin-snapshotter-role Jun 18 07:32:03.819: INFO: deleting *v1.StatefulSet: provisioning-8111-3307/csi-hostpathplugin Jun 18 07:32:03.918: INFO: deleting *v1.ClusterRoleBinding: psp-csi-hostpath-role-provisioning-8111 �[1mSTEP�[0m: deleting the driver namespace: provisioning-8111-3307 �[1mSTEP�[0m: Waiting for namespaces [provisioning-8111-3307] to vanish [AfterEach] [Testpattern: Dynamic PV (default fs)] provisioning test/e2e/framework/framework.go:187 Jun 18 07:32:10.155: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\scsi\-hostpath\]\s\[Testpattern\:\sEphemeral\sSnapshot\s\(delete\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\,\scheck\sdeletion\s\(ephemeral\)$'
test/e2e/storage/testsuites/snapshottable.go:177 Jun 18 06:49:09.461: VolumeSnapshot snapshot-82z8b is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [Testpattern: Ephemeral Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Ephemeral Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 18 06:43:35.542: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should check snapshot fields, check restore correctly works, check deletion (ephemeral) test/e2e/storage/testsuites/snapshottable.go:177 �[1mSTEP�[0m: Building a driver namespace object, basename snapshotting-3931 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi-hostpath driver Jun 18 06:43:36.118: INFO: creating *v1.ServiceAccount: snapshotting-3931-2623/csi-attacher Jun 18 06:43:36.155: INFO: creating *v1.ClusterRole: external-attacher-runner-snapshotting-3931 Jun 18 06:43:36.155: INFO: Define cluster role external-attacher-runner-snapshotting-3931 Jun 18 06:43:36.194: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-3931 Jun 18 06:43:36.232: INFO: creating *v1.Role: snapshotting-3931-2623/external-attacher-cfg-snapshotting-3931 Jun 18 06:43:36.268: INFO: creating *v1.RoleBinding: snapshotting-3931-2623/csi-attacher-role-cfg Jun 18 06:43:36.304: INFO: creating *v1.ServiceAccount: snapshotting-3931-2623/csi-provisioner Jun 18 06:43:36.341: INFO: creating *v1.ClusterRole: external-provisioner-runner-snapshotting-3931 Jun 18 06:43:36.341: INFO: Define cluster role external-provisioner-runner-snapshotting-3931 Jun 18 06:43:36.378: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-3931 Jun 18 06:43:36.417: INFO: creating *v1.Role: snapshotting-3931-2623/external-provisioner-cfg-snapshotting-3931 Jun 18 06:43:36.454: INFO: creating *v1.RoleBinding: snapshotting-3931-2623/csi-provisioner-role-cfg Jun 18 06:43:36.491: INFO: creating *v1.ServiceAccount: snapshotting-3931-2623/csi-snapshotter Jun 18 06:43:36.528: INFO: creating *v1.ClusterRole: external-snapshotter-runner-snapshotting-3931 Jun 18 06:43:36.528: INFO: Define cluster role external-snapshotter-runner-snapshotting-3931 Jun 18 06:43:36.567: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-snapshotting-3931 Jun 18 06:43:36.603: INFO: creating *v1.Role: snapshotting-3931-2623/external-snapshotter-leaderelection-snapshotting-3931 Jun 18 06:43:36.640: INFO: creating *v1.RoleBinding: snapshotting-3931-2623/external-snapshotter-leaderelection Jun 18 06:43:36.676: INFO: creating *v1.ServiceAccount: snapshotting-3931-2623/csi-external-health-monitor-controller Jun 18 06:43:36.713: INFO: creating *v1.ClusterRole: external-health-monitor-controller-runner-snapshotting-3931 Jun 18 06:43:36.713: INFO: Define cluster role external-health-monitor-controller-runner-snapshotting-3931 Jun 18 06:43:36.750: INFO: creating *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-snapshotting-3931 Jun 18 06:43:36.787: INFO: creating *v1.Role: snapshotting-3931-2623/external-health-monitor-controller-cfg-snapshotting-3931 Jun 18 06:43:36.824: INFO: creating *v1.RoleBinding: snapshotting-3931-2623/csi-external-health-monitor-controller-role-cfg Jun 18 06:43:36.861: INFO: creating *v1.ServiceAccount: snapshotting-3931-2623/csi-resizer Jun 18 06:43:36.898: INFO: creating *v1.ClusterRole: external-resizer-runner-snapshotting-3931 Jun 18 06:43:36.898: INFO: Define cluster role external-resizer-runner-snapshotting-3931 Jun 18 06:43:36.936: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-snapshotting-3931 Jun 18 06:43:36.975: INFO: creating *v1.Role: snapshotting-3931-2623/external-resizer-cfg-snapshotting-3931 Jun 18 06:43:37.012: INFO: creating *v1.RoleBinding: snapshotting-3931-2623/csi-resizer-role-cfg Jun 18 06:43:37.049: INFO: creating *v1.CSIDriver: csi-hostpath-snapshotting-3931 Jun 18 06:43:37.086: INFO: creating *v1.ServiceAccount: snapshotting-3931-2623/csi-hostpathplugin-sa Jun 18 06:43:37.123: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-snapshotting-3931 Jun 18 06:43:37.159: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-snapshotting-3931 Jun 18 06:43:37.197: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-snapshotting-3931 Jun 18 06:43:37.233: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-snapshotting-3931 Jun 18 06:43:37.271: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-snapshotting-3931 Jun 18 06:43:37.307: INFO: creating *v1.RoleBinding: snapshotting-3931-2623/csi-hostpathplugin-attacher-role Jun 18 06:43:37.346: INFO: creating *v1.RoleBinding: snapshotting-3931-2623/csi-hostpathplugin-health-monitor-controller-role Jun 18 06:43:37.386: INFO: creating *v1.RoleBinding: snapshotting-3931-2623/csi-hostpathplugin-provisioner-role Jun 18 06:43:37.424: INFO: creating *v1.RoleBinding: snapshotting-3931-2623/csi-hostpathplugin-resizer-role Jun 18 06:43:37.462: INFO: creating *v1.RoleBinding: snapshotting-3931-2623/csi-hostpathplugin-snapshotter-role Jun 18 06:43:37.499: INFO: creating *v1.StatefulSet: snapshotting-3931-2623/csi-hostpathplugin Jun 18 06:43:37.541: INFO: creating *v1.ClusterRoleBinding: psp-csi-hostpath-role-snapshotting-3931 Jun 18 06:43:37.592: INFO: Creating resource for dynamic PV Jun 18 06:43:37.592: INFO: Using claimSize:1Mi, test suite supported size:{ 1Mi}, driver(csi-hostpath) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-393148pgq �[1mSTEP�[0m: [init] starting a pod to use the claim Jun 18 06:43:37.681: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-qlpkx" in namespace "snapshotting-3931" to be "Succeeded or Failed" Jun 18 06:43:37.725: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 43.508348ms Jun 18 06:43:39.763: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 2.081340892s Jun 18 06:43:41.762: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 4.080914436s Jun 18 06:43:43.763: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 6.081305727s Jun 18 06:43:45.763: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 8.081380984s Jun 18 06:43:47.763: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 10.081290472s Jun 18 06:43:49.768: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 12.087098777s Jun 18 06:43:51.762: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 14.08095618s Jun 18 06:43:53.763: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 16.081352923s Jun 18 06:43:55.762: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 18.080556304s Jun 18 06:43:57.763: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 20.081806534s Jun 18 06:43:59.762: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 22.080339256s Jun 18 06:44:01.762: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 24.080895628s Jun 18 06:44:03.762: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 26.080699549s Jun 18 06:44:05.761: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Pending", Reason="", readiness=false. Elapsed: 28.079993403s Jun 18 06:44:07.762: INFO: Pod "pvc-snapshottable-tester-qlpkx": Phase="Succeeded", Reason="", readiness=false. Elapsed: 30.081031114s �[1mSTEP�[0m: Saw pod success Jun 18 06:44:07.762: INFO: Pod "pvc-snapshottable-tester-qlpkx" satisfied condition "Succeeded or Failed" �[1mSTEP�[0m: [init] checking the claim �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 18 06:44:07.918: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-82z8b to become ready Jun 18 06:44:07.969: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:10.006: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:12.043: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:14.080: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:16.117: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:18.154: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:20.190: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:22.227: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:24.265: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:26.302: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:28.341: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:30.378: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:32.415: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:34.452: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:36.489: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:38.526: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:40.563: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:42.601: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:44.639: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:46.676: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:48.714: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:50.751: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:52.788: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:54.825: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:56.863: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:44:58.901: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:00.938: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:02.975: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:05.012: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:07.048: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:09.085: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:11.122: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:13.160: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:15.197: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:17.234: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:19.277: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:21.313: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:23.357: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:25.394: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:27.432: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:29.469: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:31.506: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:33.543: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:35.580: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:37.618: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:39.655: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:41.690: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:43.730: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:45.766: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:47.803: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:49.841: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:51.877: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:53.915: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:55.951: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:45:57.989: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:00.026: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:02.068: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:04.105: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:06.142: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:08.179: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:10.216: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:12.253: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:14.289: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:16.327: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:18.363: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:20.401: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:22.439: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:24.478: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:26.517: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:28.553: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:30.589: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:32.627: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:34.664: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:36.701: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:38.738: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:40.774: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:42.812: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:44.849: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:46.885: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:48.922: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:50.958: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:52.995: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:55.032: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:57.068: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:46:59.105: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:01.142: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:03.180: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:05.217: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:07.253: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:09.289: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:11.326: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:13.362: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:15.400: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:17.437: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:19.476: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:21.513: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:23.550: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:25.589: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:27.625: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:29.663: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:31.700: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:33.738: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:35.775: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:37.812: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:39.850: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:41.887: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:43.923: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:45.959: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:47.996: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:50.034: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:52.073: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:54.111: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:56.147: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:47:58.184: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:00.220: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:02.258: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:04.296: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:06.332: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:08.368: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:10.405: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:12.443: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:14.480: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:16.517: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:18.554: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:20.591: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:22.635: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:24.672: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:26.709: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:28.746: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:30.782: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:32.820: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:34.857: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:36.894: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:38.931: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:40.969: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:43.006: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:45.043: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:47.082: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:49.119: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:51.156: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:53.193: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:55.230: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:57.267: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:48:59.305: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:49:01.349: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:49:03.385: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:49:05.422: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:49:07.459: INFO: VolumeSnapshot snapshot-82z8b found but is not ready. Jun 18 06:49:09.460: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 18 06:49:09.460: INFO: Unexpected error: <*errors.errorString | 0xc000f06cc0>: { s: "VolumeSnapshot snapshot-82z8b is not ready within 5m0s", } Jun 18 06:49:09.461: FAIL: VolumeSnapshot snapshot-82z8b is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc0036661d0?}, 0xc003242350) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7fdc384f5248, 0xc0011a6c00}, 0xc0042ff440, {{0x71d38bc, 0x22}, {0x0, 0x0}, {0x717cce1, 0x16}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.4.1() test/e2e/storage/testsuites/snapshottable.go:208 +0x4aa k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24d6d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007ba680, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f Jun 18 06:49:09.461: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-snapshottable-tester-qlpkx-my-volume] to have phase Bound Jun 18 06:49:09.497: INFO: PersistentVolumeClaim pvc-snapshottable-tester-qlpkx-my-volume found and phase=Bound (35.865089ms) �[1mSTEP�[0m: [init] checking the PV �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the snapshot Jun 18 06:49:09.756: INFO: Waiting up to 15m0s for pod "restored-pvc-tester-lfjgl" in namespace "snapshotting-3931" to be "running" Jun 18 06:49:09.795: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 39.253146ms Jun 18 06:49:11.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.076404331s Jun 18 06:49:13.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.076070082s Jun 18 06:49:15.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.075324438s Jun 18 06:49:17.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8.075206552s Jun 18 06:49:19.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10.076333481s Jun 18 06:49:21.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12.075697129s Jun 18 06:49:23.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14.077886548s Jun 18 06:49:25.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 16.07518159s Jun 18 06:49:27.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 18.076647714s Jun 18 06:49:29.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 20.075250119s Jun 18 06:49:31.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 22.075612729s Jun 18 06:49:33.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 24.075319874s Jun 18 06:49:35.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 26.077344648s Jun 18 06:49:37.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 28.079199051s Jun 18 06:49:39.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 30.075170441s Jun 18 06:49:41.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 32.075008357s Jun 18 06:49:43.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 34.075519216s Jun 18 06:49:45.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 36.078658237s Jun 18 06:49:47.840: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 38.084081743s Jun 18 06:49:49.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 40.075369299s Jun 18 06:49:51.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 42.075420291s Jun 18 06:49:53.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 44.076677876s Jun 18 06:49:55.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 46.075361508s Jun 18 06:49:57.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 48.075569898s Jun 18 06:49:59.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 50.075850669s Jun 18 06:50:01.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 52.075610671s Jun 18 06:50:03.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 54.075850456s Jun 18 06:50:05.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 56.075490609s Jun 18 06:50:07.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 58.0747558s Jun 18 06:50:09.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.078648712s Jun 18 06:50:11.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.076256608s Jun 18 06:50:13.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.075567936s Jun 18 06:50:15.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.075743867s Jun 18 06:50:17.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.075864939s Jun 18 06:50:19.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.077016746s Jun 18 06:50:21.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.076197366s Jun 18 06:50:23.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.074768336s Jun 18 06:50:25.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.075950046s Jun 18 06:50:27.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.076293743s Jun 18 06:50:29.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.076076656s Jun 18 06:50:31.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.077887365s Jun 18 06:50:33.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.075116837s Jun 18 06:50:35.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.077326562s Jun 18 06:50:37.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.076180222s Jun 18 06:50:39.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.075375796s Jun 18 06:50:41.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.075537634s Jun 18 06:50:43.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.075049604s Jun 18 06:50:45.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.076054258s Jun 18 06:50:47.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.076458661s Jun 18 06:50:49.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.077523963s Jun 18 06:50:51.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.076289563s Jun 18 06:50:53.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.076172405s Jun 18 06:50:55.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.07594663s Jun 18 06:50:57.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.075442759s Jun 18 06:50:59.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.077147258s Jun 18 06:51:01.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.076114443s Jun 18 06:51:03.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.07722875s Jun 18 06:51:05.836: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.079482254s Jun 18 06:51:07.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.075060632s Jun 18 06:51:09.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.076616237s Jun 18 06:51:11.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.075929596s Jun 18 06:51:13.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.078368278s Jun 18 06:51:15.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.078446431s Jun 18 06:51:17.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.079105265s Jun 18 06:51:19.841: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.084891379s Jun 18 06:51:21.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.076665168s Jun 18 06:51:23.851: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.095162918s Jun 18 06:51:25.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.078585066s Jun 18 06:51:27.847: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.090446343s Jun 18 06:51:29.837: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.080424665s Jun 18 06:51:31.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.076607676s Jun 18 06:51:33.837: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.081079474s Jun 18 06:51:35.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.078384016s Jun 18 06:51:37.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.078438673s Jun 18 06:51:39.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.078326266s Jun 18 06:51:41.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.077397566s Jun 18 06:51:43.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.078229417s Jun 18 06:51:45.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.078372054s Jun 18 06:51:47.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.077873462s Jun 18 06:51:49.836: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.079483213s Jun 18 06:51:51.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.078490564s Jun 18 06:51:53.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.077857137s Jun 18 06:51:55.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.078671935s Jun 18 06:51:57.893: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.136840412s Jun 18 06:51:59.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.078367866s Jun 18 06:52:01.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.078360714s Jun 18 06:52:03.854: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.098304537s Jun 18 06:52:05.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.078336504s Jun 18 06:52:07.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.076930321s Jun 18 06:52:09.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.079074767s Jun 18 06:52:11.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.078505161s Jun 18 06:52:13.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.07727945s Jun 18 06:52:15.839: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.082515656s Jun 18 06:52:17.833: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.077266311s Jun 18 06:52:19.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.078409999s Jun 18 06:52:21.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.07454885s Jun 18 06:52:23.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.076185698s Jun 18 06:52:25.831: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.074470617s Jun 18 06:52:27.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.128596162s Jun 18 06:52:29.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.12845019s Jun 18 06:52:31.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.128104954s Jun 18 06:52:33.886: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.129509838s Jun 18 06:52:35.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.128002006s Jun 18 06:52:37.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.127933793s Jun 18 06:52:39.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.128279473s Jun 18 06:52:41.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.129351839s Jun 18 06:52:43.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.127968719s Jun 18 06:52:45.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.12851754s Jun 18 06:52:47.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.128570742s Jun 18 06:52:49.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.127904945s Jun 18 06:52:51.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.128512275s Jun 18 06:52:53.887: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.130529659s Jun 18 06:52:55.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.129220192s Jun 18 06:52:57.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.127548697s Jun 18 06:52:59.888: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.13157345s Jun 18 06:53:01.895: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.139187293s Jun 18 06:53:03.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.128043965s Jun 18 06:53:05.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.128753481s Jun 18 06:53:07.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.128779034s Jun 18 06:53:09.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.128873909s Jun 18 06:53:11.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.12862298s Jun 18 06:53:13.886: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.129505973s Jun 18 06:53:15.896: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.14004072s Jun 18 06:53:17.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.128864954s Jun 18 06:53:19.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.128561872s Jun 18 06:53:21.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.128755022s Jun 18 06:53:23.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.127708654s Jun 18 06:53:25.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.128492507s Jun 18 06:53:27.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.128072804s Jun 18 06:53:29.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.127797247s Jun 18 06:53:31.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.128665493s Jun 18 06:53:33.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.128490014s Jun 18 06:53:35.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.128332746s Jun 18 06:53:37.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.129206672s Jun 18 06:53:39.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.128595495s Jun 18 06:53:41.910: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.154320577s Jun 18 06:53:43.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.128707732s Jun 18 06:53:45.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.128219548s Jun 18 06:53:47.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.128296073s Jun 18 06:53:49.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.128949976s Jun 18 06:53:51.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.128060423s Jun 18 06:53:53.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.127527437s Jun 18 06:53:55.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.12895532s Jun 18 06:53:57.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.128791603s Jun 18 06:53:59.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.127800477s Jun 18 06:54:01.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.128130196s Jun 18 06:54:03.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.128228239s Jun 18 06:54:05.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.1288448s Jun 18 06:54:07.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.128470703s Jun 18 06:54:09.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.078061049s Jun 18 06:54:11.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.128022444s Jun 18 06:54:13.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.128331715s Jun 18 06:54:15.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.127458529s Jun 18 06:54:17.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.128258306s Jun 18 06:54:19.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.127608392s Jun 18 06:54:21.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.128488048s Jun 18 06:54:23.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.128451681s Jun 18 06:54:25.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.128402278s Jun 18 06:54:27.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.128590217s Jun 18 06:54:29.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.128506328s Jun 18 06:54:31.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.127968792s Jun 18 06:54:33.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.127691291s Jun 18 06:54:35.887: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.130557286s Jun 18 06:54:37.888: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.132262803s Jun 18 06:54:39.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.127894129s Jun 18 06:54:41.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.127667986s Jun 18 06:54:43.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m34.127883551s Jun 18 06:54:45.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m36.127526723s Jun 18 06:54:47.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m38.127758476s Jun 18 06:54:49.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m40.128118966s Jun 18 06:54:51.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m42.12875134s Jun 18 06:54:53.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m44.128929667s Jun 18 06:54:55.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m46.128259482s Jun 18 06:54:57.886: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m48.130178882s Jun 18 06:54:59.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.127799858s Jun 18 06:55:01.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.128417654s Jun 18 06:55:03.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.128189885s Jun 18 06:55:05.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.128391085s Jun 18 06:55:07.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.129162866s Jun 18 06:55:09.836: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.079366121s Jun 18 06:55:11.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.127809306s Jun 18 06:55:13.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.128442937s Jun 18 06:55:15.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.127852326s Jun 18 06:55:17.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.12763762s Jun 18 06:55:19.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.128240467s Jun 18 06:55:21.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.128304808s Jun 18 06:55:23.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.128662892s Jun 18 06:55:25.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.128162341s Jun 18 06:55:27.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.127973328s Jun 18 06:55:29.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.128366921s Jun 18 06:55:31.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.128499557s Jun 18 06:55:33.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.128297114s Jun 18 06:55:35.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.127899829s Jun 18 06:55:37.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.12789059s Jun 18 06:55:39.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.128528662s Jun 18 06:55:41.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.12783594s Jun 18 06:55:43.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.128019694s Jun 18 06:55:45.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.128403838s Jun 18 06:55:47.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.128850862s Jun 18 06:55:49.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.075698759s Jun 18 06:55:51.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.128309702s Jun 18 06:55:53.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m44.128983948s Jun 18 06:55:55.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m46.12762729s Jun 18 06:55:57.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m48.128890008s Jun 18 06:55:59.845: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m50.088631067s Jun 18 06:56:01.902: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m52.146093231s Jun 18 06:56:03.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.128888599s Jun 18 06:56:05.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.128629453s Jun 18 06:56:07.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.129055985s Jun 18 06:56:09.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.075687662s Jun 18 06:56:11.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.129286142s Jun 18 06:56:13.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.128812982s Jun 18 06:56:15.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.128181118s Jun 18 06:56:17.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.128520753s Jun 18 06:56:19.895: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.138882072s Jun 18 06:56:21.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.128410973s Jun 18 06:56:23.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.12795702s Jun 18 06:56:25.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m16.128188816s Jun 18 06:56:27.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m18.128048992s Jun 18 06:56:29.947: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m20.19080104s Jun 18 06:56:31.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m22.128285579s Jun 18 06:56:33.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m24.127954103s Jun 18 06:56:35.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m26.128368655s Jun 18 06:56:37.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m28.127376179s Jun 18 06:56:39.890: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m30.133876073s Jun 18 06:56:41.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m32.127817132s Jun 18 06:56:43.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m34.127761356s Jun 18 06:56:45.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m36.128214319s Jun 18 06:56:47.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m38.127720342s Jun 18 06:56:49.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m40.127613886s Jun 18 06:56:51.883: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m42.127334675s Jun 18 06:56:53.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m44.127984048s Jun 18 06:56:55.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m46.127705509s Jun 18 06:56:57.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.128036976s Jun 18 06:56:59.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.128280563s Jun 18 06:57:01.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.128333816s Jun 18 06:57:03.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.128347496s Jun 18 06:57:05.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.128628503s Jun 18 06:57:07.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.128961317s Jun 18 06:57:09.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.127383676s Jun 18 06:57:11.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m2.128615025s Jun 18 06:57:13.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m4.128620422s Jun 18 06:57:15.886: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m6.129574176s Jun 18 06:57:17.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m8.128289982s Jun 18 06:57:19.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m10.128126161s Jun 18 06:57:21.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m12.127825343s Jun 18 06:57:23.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m14.127950072s Jun 18 06:57:25.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m16.127719893s Jun 18 06:57:27.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m18.128276601s Jun 18 06:57:29.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m20.127680315s Jun 18 06:57:31.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m22.128462698s Jun 18 06:57:33.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m24.127576838s Jun 18 06:57:35.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m26.128552496s Jun 18 06:57:37.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m28.128701846s Jun 18 06:57:39.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m30.127922251s Jun 18 06:57:41.895: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.13909501s Jun 18 06:57:43.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.127556212s Jun 18 06:57:45.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.129253968s Jun 18 06:57:47.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.127380849s Jun 18 06:57:49.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.127492343s Jun 18 06:57:51.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.128376051s Jun 18 06:57:53.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.128320026s Jun 18 06:57:55.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m46.127797909s Jun 18 06:57:57.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m48.12797488s Jun 18 06:57:59.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m50.12847814s Jun 18 06:58:01.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m52.127884257s Jun 18 06:58:03.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m54.127698771s Jun 18 06:58:05.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m56.128148474s Jun 18 06:58:07.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 8m58.128111168s Jun 18 06:58:09.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m0.12811781s Jun 18 06:58:11.886: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m2.130328895s Jun 18 06:58:13.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m4.128949543s Jun 18 06:58:15.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m6.129291453s Jun 18 06:58:17.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m8.127499268s Jun 18 06:58:19.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m10.127586464s Jun 18 06:58:21.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m12.127737607s Jun 18 06:58:23.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m14.128335093s Jun 18 06:58:25.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m16.128777518s Jun 18 06:58:27.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m18.128001704s Jun 18 06:58:29.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m20.127984979s Jun 18 06:58:31.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m22.128278963s Jun 18 06:58:33.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m24.127618286s Jun 18 06:58:35.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m26.128314515s Jun 18 06:58:37.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m28.12778982s Jun 18 06:58:39.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m30.128756052s Jun 18 06:58:41.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m32.128089553s Jun 18 06:58:43.886: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m34.129690567s Jun 18 06:58:45.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m36.129229337s Jun 18 06:58:47.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m38.127865206s Jun 18 06:58:49.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m40.12880986s Jun 18 06:58:51.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m42.128568305s Jun 18 06:58:53.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m44.128191987s Jun 18 06:58:55.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m46.128516507s Jun 18 06:58:57.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m48.127372982s Jun 18 06:58:59.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m50.127984031s Jun 18 06:59:01.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m52.128107658s Jun 18 06:59:03.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m54.128257903s Jun 18 06:59:05.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m56.127732898s Jun 18 06:59:07.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 9m58.128295328s Jun 18 06:59:09.887: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m0.131314147s Jun 18 06:59:11.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m2.12850388s Jun 18 06:59:13.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m4.128637142s Jun 18 06:59:15.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m6.128121024s Jun 18 06:59:17.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m8.128436597s Jun 18 06:59:19.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m10.128356689s Jun 18 06:59:21.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m12.1285692s Jun 18 06:59:23.894: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m14.137551814s Jun 18 06:59:25.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m16.128476027s Jun 18 06:59:27.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m18.128417566s Jun 18 06:59:29.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m20.128691011s Jun 18 06:59:31.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m22.127853517s Jun 18 06:59:33.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m24.128970907s Jun 18 06:59:35.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m26.128412023s Jun 18 06:59:37.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m28.128560632s Jun 18 06:59:39.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m30.128480287s Jun 18 06:59:41.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m32.127685041s Jun 18 06:59:43.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m34.127955456s Jun 18 06:59:45.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m36.127395968s Jun 18 06:59:47.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m38.127995435s Jun 18 06:59:49.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m40.128564958s Jun 18 06:59:51.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m42.128580394s Jun 18 06:59:53.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m44.12774024s Jun 18 06:59:55.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m46.128709937s Jun 18 06:59:57.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m48.128352672s Jun 18 06:59:59.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m50.128095401s Jun 18 07:00:01.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m52.127928366s Jun 18 07:00:03.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m54.127991586s Jun 18 07:00:05.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m56.12774097s Jun 18 07:00:07.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 10m58.128043978s Jun 18 07:00:09.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m0.078333951s Jun 18 07:00:11.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m2.128206173s Jun 18 07:00:13.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m4.128831504s Jun 18 07:00:15.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m6.128876282s Jun 18 07:00:17.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m8.128619733s Jun 18 07:00:19.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m10.129214669s Jun 18 07:00:21.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m12.128649155s Jun 18 07:00:23.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m14.127767456s Jun 18 07:00:25.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m16.128000711s Jun 18 07:00:27.887: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m18.131127529s Jun 18 07:00:29.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m20.127763658s Jun 18 07:00:31.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m22.128772549s Jun 18 07:00:33.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m24.128184466s Jun 18 07:00:35.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m26.128250961s Jun 18 07:00:37.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m28.128621406s Jun 18 07:00:39.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m30.128050968s Jun 18 07:00:41.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m32.128686569s Jun 18 07:00:43.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m34.128030639s Jun 18 07:00:45.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m36.127677781s Jun 18 07:00:47.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m38.127966304s Jun 18 07:00:49.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m40.128820157s Jun 18 07:00:51.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m42.128208142s Jun 18 07:00:53.886: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m44.130222639s Jun 18 07:00:55.917: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m46.161338946s Jun 18 07:00:57.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m48.128313481s Jun 18 07:00:59.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m50.128798905s Jun 18 07:01:01.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m52.128843365s Jun 18 07:01:03.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m54.128477618s Jun 18 07:01:05.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m56.128472172s Jun 18 07:01:07.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 11m58.129202669s Jun 18 07:01:09.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m0.077778646s Jun 18 07:01:11.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m2.078775925s Jun 18 07:01:13.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m4.128513533s Jun 18 07:01:15.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m6.128965647s Jun 18 07:01:17.886: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m8.129853017s Jun 18 07:01:19.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m10.128868142s Jun 18 07:01:21.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m12.077399136s Jun 18 07:01:23.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m14.128590098s Jun 18 07:01:25.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m16.128806275s Jun 18 07:01:27.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m18.128525884s Jun 18 07:01:29.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m20.12816455s Jun 18 07:01:31.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m22.12798732s Jun 18 07:01:33.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m24.128333346s Jun 18 07:01:35.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m26.127620272s Jun 18 07:01:37.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m28.127761229s Jun 18 07:01:39.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m30.128877147s Jun 18 07:01:41.934: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m32.177920606s Jun 18 07:01:43.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m34.127656912s Jun 18 07:01:45.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m36.128112502s Jun 18 07:01:47.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m38.127732132s Jun 18 07:01:49.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m40.127942068s Jun 18 07:01:51.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m42.127968418s Jun 18 07:01:53.891: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m44.13469833s Jun 18 07:01:55.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m46.127868566s Jun 18 07:01:57.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m48.128106554s Jun 18 07:01:59.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m50.128254305s Jun 18 07:02:01.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m52.128733523s Jun 18 07:02:03.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m54.128835676s Jun 18 07:02:05.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m56.128572802s Jun 18 07:02:07.832: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 12m58.076326446s Jun 18 07:02:09.834: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m0.077686292s Jun 18 07:02:11.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m2.127823634s Jun 18 07:02:13.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m4.12791695s Jun 18 07:02:15.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m6.128198761s Jun 18 07:02:17.929: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m8.172537425s Jun 18 07:02:19.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m10.128017583s Jun 18 07:02:21.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m12.12750584s Jun 18 07:02:23.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m14.128353978s Jun 18 07:02:25.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m16.128242668s Jun 18 07:02:27.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m18.128307681s Jun 18 07:02:29.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m20.127808681s Jun 18 07:02:31.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m22.127522812s Jun 18 07:02:33.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m24.127986622s Jun 18 07:02:35.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m26.128519181s Jun 18 07:02:37.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m28.128366099s Jun 18 07:02:39.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m30.128480239s Jun 18 07:02:41.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m32.127807631s Jun 18 07:02:43.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m34.128289883s Jun 18 07:02:45.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m36.127693701s Jun 18 07:02:47.886: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m38.13006165s Jun 18 07:02:49.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m40.128506246s Jun 18 07:02:51.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m42.12836608s Jun 18 07:02:53.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m44.128278014s Jun 18 07:02:55.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m46.128886088s Jun 18 07:02:57.893: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m48.136726991s Jun 18 07:02:59.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m50.128310806s Jun 18 07:03:01.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m52.127975008s Jun 18 07:03:03.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m54.128052205s Jun 18 07:03:05.883: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m56.126938953s Jun 18 07:03:07.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 13m58.128474805s Jun 18 07:03:09.835: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m0.078706352s Jun 18 07:03:11.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m2.127924673s Jun 18 07:03:13.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m4.128043409s Jun 18 07:03:15.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m6.128355147s Jun 18 07:03:17.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m8.127925173s Jun 18 07:03:19.902: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m10.145820003s Jun 18 07:03:21.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m12.128088121s Jun 18 07:03:23.883: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m14.127252147s Jun 18 07:03:25.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m16.128253273s Jun 18 07:03:27.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m18.12808469s Jun 18 07:03:29.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m20.127637667s Jun 18 07:03:31.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m22.128789654s Jun 18 07:03:33.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m24.129005661s Jun 18 07:03:35.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m26.128234976s Jun 18 07:03:37.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m28.127965456s Jun 18 07:03:39.837: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m30.080707516s Jun 18 07:03:41.883: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m32.127031362s Jun 18 07:03:43.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m34.127698123s Jun 18 07:03:45.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m36.128267479s Jun 18 07:03:47.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m38.127635693s Jun 18 07:03:49.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m40.128013816s Jun 18 07:03:51.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m42.127893586s Jun 18 07:03:53.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m44.128221699s Jun 18 07:03:55.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m46.12808261s Jun 18 07:03:57.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m48.12827218s Jun 18 07:03:59.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m50.12840685s Jun 18 07:04:01.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m52.128689368s Jun 18 07:04:03.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m54.128243299s Jun 18 07:04:05.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m56.128420912s Jun 18 07:04:07.884: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 14m58.127622909s Jun 18 07:04:09.885: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.128416677s Jun 18 07:04:09.984: INFO: Pod "restored-pvc-tester-lfjgl": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.228275416s Jun 18 07:04:09.986: INFO: Unexpected error: <*pod.timeoutError | 0xc00221ae10>: { msg: "timed out while waiting for pod snapshotting-3931/restored-pvc-tester-lfjgl to be running", observedObjects: [ { TypeMeta: {Kind: "", APIVersion: ""}, ObjectMeta: { Name: "restored-pvc-tester-lfjgl", GenerateName: "restored-pvc-tester-", Namespace: "snapshotting-3931", SelfLink: "", UID: "7e3f52e0-1f7b-48ee-8417-3b3a834d8ca6", ResourceVersion: "8798", Generation: 0, CreationTimestamp: { Time: { wall: 0, ext: 63791131749, loc: { name: "Local", zone: [ {name: "UTC", offset: 0, isDST: false}, ], tx: [ { when: -576460752303423488, index: 0, isstd: false, isutc: false, }, ], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: "UTC", offset: 0, isDST: false}, }, }, }, DeletionTimestamp: nil, DeletionGracePeriodSeconds: nil, Labels: { "app": "restored-pvc-tester", }, Annotations: nil, OwnerReferences: nil, Finalizers: nil, ManagedFields: [ { Manager: "e2e.test", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63791131749, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:metadata\":{\"f:generateName\":{},\"f:labels\":{\".\":{},\"f:app\":{}}},\"f:spec\":{\"f:affinity\":{\".\":{},\"f:nodeAffinity\":{\".\":{},\"f:requiredDuringSchedulingIgnoredDuringExecution\":{}}},\"f:containers\":{\"k:{\\\"name\\\":\\\"volume-tester\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{},\"f:volumeMounts\":{\".\":{},\"k:{\\\"mountPath\\\":\\\"/mnt/test\\\"}\":{\".\":{},\"f:mountPath\":{},\"f:name\":{}}}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{},\"f:volumes\":{\".\":{},\"k:{\\\"name\\\":\\\"my-volume\\\"}\":{\".\":{},\"f:ephemeral\":{\".\":{},\"f:volumeClaimTemplate\":{\".\":{},\"f:metadata\":{\".\":{},\"f:creationTimestamp\":{}},\"f:spec\":{\".\":{},\"f:accessModes\":{},\"f:dataSource\":{},\"f:resources\":{\".\":{},\"f:requests\":{\".\":{},\"f:storage\":{}}},\"f:storageClassName\":{},\"f:volumeMode\":{}}}},\"f:name\":{}}}}}", }, Subresource: "", }, { Manager: "kube-scheduler", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63791131751, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:status\":{\"f:conditions\":{\".\":{},\"k:{\\\"type\\\":\\\"PodScheduled\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}}}}", }, Subresource: "status", }, ], }, Spec: { Volumes: [ { Name: "my-volume", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, Secret: nil, NFS: nil, ISCSI: nil, Glusterfs: nil, PersistentVolumeClaim: nil, RBD: nil, FlexVolume: nil, Cinder: nil, CephFS: nil, Flocker: nil, DownwardAPI: nil, FC: nil, AzureFile: nil, ConfigMap: nil, VsphereVolume: nil, Quobyte: nil, AzureDisk: nil, PhotonPersistentDisk: nil, Projected: nil, PortworxVolume: nil, ScaleIO: nil, StorageOS: nil, CSI: nil, Ephemeral: { VolumeClaimTemplate: { ObjectMeta: { Name: ..., GenerateName: ..., Namespace: ..., SelfLink: ..., UID: ..., ResourceVersion: ..., Generation: ..., CreationTimestamp: ..., DeletionTimestamp: ..., DeletionGracePeriodSeconds: ..., Labels: ..., Annotations: ..., OwnerReferences: ..., Finalizers: ..., ManagedFields: ..., }, Spec: { AccessModes: ..., Selector: ..., Resources: ..., VolumeName: ..., StorageClassName: ..., VolumeMode: ..., DataSource: ..., DataSourceRef: ..., }, }, }, }, }, { Name: "kube-api-access-zgr96", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, Secret: nil, NFS: nil, ISCSI: nil, Glusterfs: nil, PersistentVolumeClaim: nil, RBD: nil, FlexVolume: nil, Cinder: nil, CephFS: nil, Flocker: nil, DownwardAPI: nil, FC: nil, AzureFile: nil, ConfigMap: nil, VsphereVolume: nil, Quobyte: nil, AzureDisk: nil, PhotonPersistentDisk: nil, Projected: { Sources: [ { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, ], DefaultMode: 420, }, PortworxVolume: nil, ScaleIO: nil, StorageOS: nil, CSI: nil, Ephemeral: nil, }, }, ], InitContainers: nil, Containers: [ { Name: "volume-tester", Image: "registry.k8s.io/e2e-test-images/busybox:1.29-2", Command: ["/bin/sh", "-c", "sleep 300"], Args: nil, WorkingDir: "", Ports: nil, EnvFrom: nil, Env: nil, Resources: {Limits: nil, Requests: nil}, VolumeMounts: [ { Name: "my-volume", ReadOnly: false, MountPath: "/mnt/test", SubPath: "", MountPropagation: nil, SubPathExpr: "", }, { Name: "kube-api-access-zgr96", ReadOnly: true, MountPath: "/var/run/secrets/kubernetes.io/serviceaccount", SubPath: "", MountPropagation: nil, SubPathExpr: "", }, ], VolumeDevices: nil, LivenessProbe: nil, ReadinessProbe: nil, StartupProbe: nil, Lifecycle: nil, TerminationMessagePath: "/dev/termination-log", TerminationMessagePolicy: "File", ImagePullPolicy: "IfNotPresent", SecurityContext: nil, Stdin: false, StdinOnce: false, TTY: false, }, ], EphemeralContainers: nil, RestartPolicy: "Never", TerminationGracePeriodSeconds: 30, ActiveDeadlineSeconds: nil, DNSPolicy: "ClusterFirst", NodeSelector: nil, ServiceAccountName: "default", DeprecatedServiceAccount: "default", AutomountServiceAccountToken: nil, NodeName: "", HostNetwork: false, HostPID: false, HostIPC: false, ShareProcessNamespace: nil, SecurityContext: { SELinuxOptions: nil, WindowsOptions: nil, RunAsUser: nil, RunAsGroup: nil, RunAsNonRoot: nil, SupplementalGroups: nil, FSGroup: nil, Sysctls: nil, FSGroupChangePolicy: nil, SeccompProfile: nil, }, ImagePullSecrets: nil, Hostname: "", Subdomain: "", Affinity: { NodeAffinity: { RequiredDuringSchedulingIgnoredDuringExecution: { NodeSelectorTerms: [ { MatchExpressions: nil, MatchFields: [...], }, ], }, PreferredDuringSchedulingIgnoredDuringExecution: nil, }, PodAffinity: nil, PodAntiAffinity: nil, }, SchedulerName: "default-scheduler", Tolerations: [ { Key: "node.kubernetes.io/not-ready", Operator: "Exists", Value: "", Effect: "NoExecute", TolerationSeconds: 300, }, { Key: "node.kubernetes.io/unreachable", Operator: "Exists", Value: "", Effect: "NoExecute", TolerationSeconds: 300, }, ], HostAliases: nil, PriorityClassName: "", Priority: 0, DNSConfig: nil, ReadinessGates: nil, RuntimeClassName: nil, EnableServiceLinks: true, PreemptionPolicy: "PreemptLowerPriority", Overhead: nil, TopologySpreadConstraints: nil, SetHostnameAsFQDN: nil, OS: nil, }, Status: { Phase: "Pending", Conditions: [ { Type: "PodScheduled", Status: "False", LastProbeTime: { Time: {wall: 0, ext: 0, loc: nil}, }, LastTransitionTime: { Time: { wall: 0, ext: 63791131749, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, Reason: "Unschedulable", Message: "0/4 nodes are available: 4 pod has unbound immediate PersistentVolumeClaims. preemption: 0/4 nodes are available: 4 Preemption is not helpful for scheduling.", }, ], Message: "", Reason: "", NominatedNodeName: "", HostIP: "", PodIP: "", PodIPs: nil, StartTime: nil, InitContainerStatuses: nil, ContainerStatuses: nil, QOSClass: "BestEffort", EphemeralContainerStatuses: nil, }, }, ], } Jun 18 07:04:09.986: FAIL: timed out while waiting for pod snapshotting-3931/restored-pvc-tester-lfjgl to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.4.1() test/e2e/storage/testsuites/snapshottable.go:260 +0xf05 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24d6d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007ba680, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f [AfterEach] volume snapshot controller test/e2e/storage/testsuites/snapshottable.go:172 Jun 18 07:04:10.084: INFO: Pod restored-pvc-tester-lfjgl has the following logs: Jun 18 07:04:10.084: INFO: Deleting pod "restored-pvc-tester-lfjgl" in namespace "snapshotting-3931" Jun 18 07:04:10.200: INFO: Wait up to 5m0s for pod "restored-pvc-tester-lfjgl" to be fully deleted Jun 18 07:04:10.316: INFO: deleting snapshot "snapshotting-3931"/"snapshot-82z8b" Jun 18 07:04:10.365: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f readyToUse:false] Jun 18 07:04:10.365: INFO: snapshotContentName snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f Jun 18 07:04:10.486: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f to be deleted Jun 18 07:04:10.522: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:12.560: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:14.596: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:16.634: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:18.670: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:20.707: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:22.744: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:24.781: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:26.817: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:28.854: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:30.891: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:32.928: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:34.964: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:37.001: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:39.038: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:41.073: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:43.111: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:45.147: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:47.187: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:49.223: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:51.277: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:53.314: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:55.350: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:57.388: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:04:59.425: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:01.522: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:03.559: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:05.602: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:07.639: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:09.676: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:11.712: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:13.749: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:15.794: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:17.830: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:19.873: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:21.910: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:23.947: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:25.988: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:28.025: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:30.067: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:32.104: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:34.140: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:36.177: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:38.214: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:40.251: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:42.291: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:44.328: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:46.365: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:48.402: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:50.439: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:52.476: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:54.514: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:56.550: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:05:58.588: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:00.625: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:02.664: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:04.701: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:06.805: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:08.842: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:10.879: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:12.917: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:14.954: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:16.991: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:19.027: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:21.065: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:23.101: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:25.137: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:27.173: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:29.210: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:31.247: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:33.284: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:35.321: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:37.358: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:39.395: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:41.431: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:43.469: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:45.505: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:47.543: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:49.580: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:51.617: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:53.655: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:55.692: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:57.728: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:06:59.765: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:01.802: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:03.838: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:05.874: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:07.910: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:09.947: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:11.984: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:14.020: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:16.056: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:18.095: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:20.131: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:22.168: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:24.206: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:26.243: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:28.280: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:30.319: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:32.356: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:34.393: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:36.431: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:38.471: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f has been found and is not deleted Jun 18 07:07:40.507: INFO: volumesnapshotcontents snapcontent-1cf8e42e-71d2-4140-9ee3-de8d8667132f is not found and has been deleted Jun 18 07:07:40.507: INFO: WaitUntil finished successfully after 3m30.020916854s Jun 18 07:07:40.507: INFO: deleting snapshot class "snapshotting-3931sdzzw" Jun 18 07:07:40.546: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-3931sdzzw to be deleted Jun 18 07:07:40.580: INFO: volumesnapshotclasses snapshotting-3931sdzzw is not found and has been deleted Jun 18 07:07:40.581: INFO: WaitUntil finished successfully after 34.723187ms Jun 18 07:07:40.581: INFO: Deleting pod "pvc-snapshottable-tester-qlpkx" in namespace "snapshotting-3931" Jun 18 07:07:40.641: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-qlpkx" to be fully deleted �[1mSTEP�[0m: Deleting sc �[1mSTEP�[0m: deleting the test namespace: snapshotting-3931 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-3931". �[1mSTEP�[0m: Found 18 events. Jun 18 07:07:40.935: INFO: At 2022-06-18 06:43:37 +0000 UTC - event for pvc-snapshottable-tester-qlpkx: {default-scheduler } FailedScheduling: 0/4 nodes are available: 4 waiting for ephemeral volume controller to create the persistentvolumeclaim "pvc-snapshottable-tester-qlpkx-my-volume". preemption: 0/4 nodes are available: 4 Preemption is not helpful for scheduling. Jun 18 07:07:40.935: INFO: At 2022-06-18 06:43:37 +0000 UTC - event for pvc-snapshottable-tester-qlpkx-my-volume: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "csi-hostpath-snapshotting-3931" or manually created by system administrator Jun 18 07:07:40.935: INFO: At 2022-06-18 06:43:38 +0000 UTC - event for pvc-snapshottable-tester-qlpkx: {default-scheduler } FailedScheduling: 0/4 nodes are available: 4 pod has unbound immediate PersistentVolumeClaims. preemption: 0/4 nodes are available: 4 Preemption is not helpful for scheduling. Jun 18 07:07:40.935: INFO: At 2022-06-18 06:43:46 +0000 UTC - event for pvc-snapshottable-tester-qlpkx-my-volume: {csi-hostpath-snapshotting-3931_csi-hostpathplugin-0_e4ddd9e7-1411-4efe-a103-d0ead1643efa } Provisioning: External provisioner is provisioning volume for claim "snapshotting-3931/pvc-snapshottable-tester-qlpkx-my-volume" Jun 18 07:07:40.935: INFO: At 2022-06-18 06:43:46 +0000 UTC - event for pvc-snapshottable-tester-qlpkx-my-volume: {csi-hostpath-snapshotting-3931_csi-hostpathplugin-0_e4ddd9e7-1411-4efe-a103-d0ead1643efa } ProvisioningSucceeded: Successfully provisioned volume pvc-7299914e-564d-4e72-a701-12e3f14eee3e Jun 18 07:07:40.935: INFO: At 2022-06-18 06:43:53 +0000 UTC - event for pvc-snapshottable-tester-qlpkx: {default-scheduler } Scheduled: Successfully assigned snapshotting-3931/pvc-snapshottable-tester-qlpkx to bootstrap-e2e-minion-group-d5bn Jun 18 07:07:40.935: INFO: At 2022-06-18 06:43:54 +0000 UTC - event for pvc-snapshottable-tester-qlpkx: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-7299914e-564d-4e72-a701-12e3f14eee3e" Jun 18 07:07:40.935: INFO: At 2022-06-18 06:44:04 +0000 UTC - event for pvc-snapshottable-tester-qlpkx: {kubelet bootstrap-e2e-minion-group-d5bn} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 18 07:07:40.935: INFO: At 2022-06-18 06:44:04 +0000 UTC - event for pvc-snapshottable-tester-qlpkx: {kubelet bootstrap-e2e-minion-group-d5bn} Created: Created container volume-tester Jun 18 07:07:40.935: INFO: At 2022-06-18 06:44:04 +0000 UTC - event for pvc-snapshottable-tester-qlpkx: {kubelet bootstrap-e2e-minion-group-d5bn} Started: Started container volume-tester Jun 18 07:07:40.935: INFO: At 2022-06-18 06:44:07 +0000 UTC - event for snapshot-82z8b: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-3931/snapshot-82z8b to be created by the CSI driver. Jun 18 07:07:40.935: INFO: At 2022-06-18 06:44:07 +0000 UTC - event for snapshot-82z8b: {snapshot-controller } SnapshotFinalizerError: Failed to check and update snapshot: snapshot controller failed to update snapshotting-3931/snapshot-82z8b on API server: volumesnapshots.snapshot.storage.k8s.io "snapshot-82z8b" is forbidden: User "system:serviceaccount:kube-system:volume-snapshot-controller" cannot patch resource "volumesnapshots" in API group "snapshot.storage.k8s.io" in the namespace "snapshotting-3931" Jun 18 07:07:40.935: INFO: At 2022-06-18 06:49:09 +0000 UTC - event for restored-pvc-tester-lfjgl: {default-scheduler } FailedScheduling: 0/4 nodes are available: 4 waiting for ephemeral volume controller to create the persistentvolumeclaim "restored-pvc-tester-lfjgl-my-volume". preemption: 0/4 nodes are available: 4 Preemption is not helpful for scheduling. Jun 18 07:07:40.935: INFO: At 2022-06-18 06:49:09 +0000 UTC - event for restored-pvc-tester-lfjgl-my-volume: {csi-hostpath-snapshotting-3931_csi-hostpathplugin-0_e4ddd9e7-1411-4efe-a103-d0ead1643efa } ProvisioningFailed: failed to provision volume with StorageClass "snapshotting-393148pgq": error getting handle for DataSource Type VolumeSnapshot by Name snapshot-82z8b: snapshot snapshot-82z8b is not Ready Jun 18 07:07:40.935: INFO: At 2022-06-18 06:49:09 +0000 UTC - event for restored-pvc-tester-lfjgl-my-volume: {csi-hostpath-snapshotting-3931_csi-hostpathplugin-0_e4ddd9e7-1411-4efe-a103-d0ead1643efa } Provisioning: External provisioner is provisioning volume for claim "snapshotting-3931/restored-pvc-tester-lfjgl-my-volume" Jun 18 07:07:40.935: INFO: At 2022-06-18 06:49:09 +0000 UTC - event for restored-pvc-tester-lfjgl-my-volume: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "csi-hostpath-snapshotting-3931" or manually created by system administrator Jun 18 07:07:40.935: INFO: At 2022-06-18 06:49:11 +0000 UTC - event for restored-pvc-tester-lfjgl: {default-scheduler } FailedScheduling: 0/4 nodes are available: 4 pod has unbound immediate PersistentVolumeClaims. preemption: 0/4 nodes are available: 4 Preemption is not helpful for scheduling. Jun 18 07:07:40.935: INFO: At 2022-06-18 07:04:10 +0000 UTC - event for restored-pvc-tester-lfjgl: {default-scheduler } FailedScheduling: skip schedule deleting pod: snapshotting-3931/restored-pvc-tester-lfjgl Jun 18 07:07:41.036: INFO: POD NODE PHASE GRACE CONDITIONS Jun 18 07:07:41.036: INFO: Jun 18 07:07:41.144: INFO: Logging node info for node bootstrap-e2e-master Jun 18 07:07:41.236: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 764be954-a567-4f02-916f-ce5a00efd5a2 10658 0 2022-06-18 05:52:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 07:04:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:37 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:37 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:37 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 07:04:37 +0000 UTC,LastTransitionTime:2022-06-18 05:52:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.44.136,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:476dc4d83f3dde8536c284cad61ff0ba,SystemUUID:476dc4d8-3f3d-de85-36c2-84cad61ff0ba,BootID:aef22f04-bc7e-4174-a5b7-27a33f86acf6,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:117361475,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 07:07:41.236: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 18 07:07:41.335: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 18 07:07:41.453: INFO: metadata-proxy-v0.1-7s94z started at 2022-06-18 05:52:25 +0000 UTC (0+2 container statuses recorded) Jun 18 07:07:41.453: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 07:07:41.453: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 07:07:41.453: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:41.453: INFO: Container kube-scheduler ready: true, restart count 0 Jun 18 07:07:41.453: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:41.453: INFO: Container etcd-container ready: true, restart count 0 Jun 18 07:07:41.453: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:41.453: INFO: Container etcd-container ready: true, restart count 0 Jun 18 07:07:41.453: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-18 05:51:33 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:41.453: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 18 07:07:41.453: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-18 05:51:34 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:41.453: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 18 07:07:41.453: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:41.453: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 18 07:07:41.453: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:41.453: INFO: Container kube-apiserver ready: true, restart count 0 Jun 18 07:07:41.453: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:41.453: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 18 07:07:41.793: INFO: Latency metrics for node bootstrap-e2e-master Jun 18 07:07:41.793: INFO: Logging node info for node bootstrap-e2e-minion-group-d5bn Jun 18 07:07:41.884: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-d5bn 424d4104-0817-4373-8508-c511cbd42736 10998 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-d5bn kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-d5bn topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-snapshotting-3931":"bootstrap-e2e-minion-group-d5bn"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 06:43:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 07:04:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 07:07:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-d5bn,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:48 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:48 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:48 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 07:04:48 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.195.245,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9894badff0283b2bf82738e3ad5d94c7,SystemUUID:9894badf-f028-3b2b-f827-38e3ad5d94c7,BootID:7a96489e-7548-4291-b5ec-4dffe1df1ef8,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 07:07:41.885: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-d5bn Jun 18 07:07:41.984: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-d5bn Jun 18 07:07:42.123: INFO: kube-proxy-bootstrap-e2e-minion-group-d5bn started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:42.123: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 07:07:42.123: INFO: metadata-proxy-v0.1-d6z5f started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 07:07:42.123: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 07:07:42.123: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 07:07:42.123: INFO: konnectivity-agent-8fmbm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:42.123: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 07:07:42.123: INFO: coredns-85bc9d67b-ggpbp started at 2022-06-18 05:52:38 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:42.123: INFO: Container coredns ready: true, restart count 0 Jun 18 07:07:42.123: INFO: csi-hostpathplugin-0 started at 2022-06-18 06:43:37 +0000 UTC (0+7 container statuses recorded) Jun 18 07:07:42.123: INFO: Container csi-attacher ready: true, restart count 0 Jun 18 07:07:42.123: INFO: Container csi-provisioner ready: true, restart count 0 Jun 18 07:07:42.123: INFO: Container csi-resizer ready: true, restart count 0 Jun 18 07:07:42.123: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 18 07:07:42.123: INFO: Container hostpath ready: true, restart count 0 Jun 18 07:07:42.123: INFO: Container liveness-probe ready: true, restart count 0 Jun 18 07:07:42.123: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 18 07:07:42.458: INFO: Latency metrics for node bootstrap-e2e-minion-group-d5bn Jun 18 07:07:42.458: INFO: Logging node info for node bootstrap-e2e-minion-group-t6ww Jun 18 07:07:42.537: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-t6ww 5e9180b3-4ff0-4628-af58-a045ab4463b5 10999 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-t6ww kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-t6ww topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 05:54:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 07:04:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 07:07:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-t6ww,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 07:04:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.105.119.210,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bf6eeb9eea04689287c5553b652cfd,SystemUUID:23bf6eeb-9eea-0468-9287-c5553b652cfd,BootID:a71f43cc-74ef-43c7-8805-f91aadd8f915,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 07:07:42.538: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-t6ww Jun 18 07:07:42.635: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-t6ww Jun 18 07:07:42.760: INFO: volume-snapshot-controller-0 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:42.760: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 18 07:07:42.760: INFO: konnectivity-agent-g7wjm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:42.760: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 07:07:42.760: INFO: kube-proxy-bootstrap-e2e-minion-group-t6ww started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:42.760: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 07:07:42.760: INFO: coredns-85bc9d67b-svgwq started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:42.760: INFO: Container coredns ready: true, restart count 0 Jun 18 07:07:42.760: INFO: kube-dns-autoscaler-5477bd659c-8dcq9 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:42.760: INFO: Container autoscaler ready: true, restart count 0 Jun 18 07:07:42.760: INFO: l7-default-backend-5f6f9745f9-x6d4r started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:42.760: INFO: Container default-http-backend ready: true, restart count 0 Jun 18 07:07:42.760: INFO: metadata-proxy-v0.1-w878c started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 07:07:42.760: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 07:07:42.760: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 07:07:43.093: INFO: Latency metrics for node bootstrap-e2e-minion-group-t6ww Jun 18 07:07:43.093: INFO: Logging node info for node bootstrap-e2e-minion-group-wxzs Jun 18 07:07:43.184: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-wxzs ea3ba9a8-6c89-4646-b31b-38927e0b4aa7 11017 0 2022-06-18 05:52:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-wxzs kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-wxzs topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 06:18:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 07:04:27 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 07:07:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-wxzs,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 07:04:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.230.184,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6715ba26207e0d851190b6989ac9096d,SystemUUID:6715ba26-207e-0d85-1190-b6989ac9096d,BootID:5cbacacb-c39e-42cb-abc9-35d40363f85b,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:dc0301d9a43e23e389abb7690cd631f98af76ea3429259c7f5f643fd31fc0a3e registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0],SizeBytes:27914152,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 07:07:43.186: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-wxzs Jun 18 07:07:43.284: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-wxzs Jun 18 07:07:43.406: INFO: kube-proxy-bootstrap-e2e-minion-group-wxzs started at 2022-06-18 05:52:20 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:43.406: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 07:07:43.406: INFO: metadata-proxy-v0.1-prz9j started at 2022-06-18 05:52:21 +0000 UTC (0+2 container statuses recorded) Jun 18 07:07:43.406: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 07:07:43.406: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jun 18 07:07:43.406: INFO: konnectivity-agent-hddcn started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:43.406: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 07:07:43.406: INFO: metrics-server-v0.5.2-755d66fb57-m6k8h started at 2022-06-18 05:52:47 +0000 UTC (0+2 container statuses recorded) Jun 18 07:07:43.406: INFO: Container metrics-server ready: true, restart count 1 Jun 18 07:07:43.406: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 18 07:07:43.733: INFO: Latency metrics for node bootstrap-e2e-minion-group-wxzs �[1mSTEP�[0m: Waiting for namespaces [snapshotting-3931] to vanish �[1mSTEP�[0m: uninstalling csi csi-hostpath driver Jun 18 07:07:49.884: INFO: deleting *v1.ServiceAccount: snapshotting-3931-2623/csi-attacher Jun 18 07:07:49.988: INFO: deleting *v1.ClusterRole: external-attacher-runner-snapshotting-3931 Jun 18 07:07:50.086: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-3931 Jun 18 07:07:50.188: INFO: deleting *v1.Role: snapshotting-3931-2623/external-attacher-cfg-snapshotting-3931 Jun 18 07:07:50.286: INFO: deleting *v1.RoleBinding: snapshotting-3931-2623/csi-attacher-role-cfg Jun 18 07:07:50.387: INFO: deleting *v1.ServiceAccount: snapshotting-3931-2623/csi-provisioner Jun 18 07:07:50.486: INFO: deleting *v1.ClusterRole: external-provisioner-runner-snapshotting-3931 Jun 18 07:07:50.586: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-3931 Jun 18 07:07:50.685: INFO: deleting *v1.Role: snapshotting-3931-2623/external-provisioner-cfg-snapshotting-3931 Jun 18 07:07:50.786: INFO: deleting *v1.RoleBinding: snapshotting-3931-2623/csi-provisioner-role-cfg Jun 18 07:07:50.885: INFO: deleting *v1.ServiceAccount: snapshotting-3931-2623/csi-snapshotter Jun 18 07:07:50.986: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-snapshotting-3931 Jun 18 07:07:51.109: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-snapshotting-3931 Jun 18 07:07:51.186: INFO: deleting *v1.Role: snapshotting-3931-2623/external-snapshotter-leaderelection-snapshotting-3931 Jun 18 07:07:51.287: INFO: deleting *v1.RoleBinding: snapshotting-3931-2623/external-snapshotter-leaderelection Jun 18 07:07:51.388: INFO: deleting *v1.ServiceAccount: snapshotting-3931-2623/csi-external-health-monitor-controller Jun 18 07:07:51.485: INFO: deleting *v1.ClusterRole: external-health-monitor-controller-runner-snapshotting-3931 Jun 18 07:07:51.586: INFO: deleting *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-snapshotting-3931 Jun 18 07:07:51.686: INFO: deleting *v1.Role: snapshotting-3931-2623/external-health-monitor-controller-cfg-snapshotting-3931 Jun 18 07:07:51.786: INFO: deleting *v1.RoleBinding: snapshotting-3931-2623/csi-external-health-monitor-controller-role-cfg Jun 18 07:07:51.887: INFO: deleting *v1.ServiceAccount: snapshotting-3931-2623/csi-resizer Jun 18 07:07:51.986: INFO: deleting *v1.ClusterRole: external-resizer-runner-snapshotting-3931 Jun 18 07:07:52.085: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-snapshotting-3931 Jun 18 07:07:52.186: INFO: deleting *v1.Role: snapshotting-3931-2623/external-resizer-cfg-snapshotting-3931 Jun 18 07:07:52.286: INFO: deleting *v1.RoleBinding: snapshotting-3931-2623/csi-resizer-role-cfg Jun 18 07:07:52.388: INFO: deleting *v1.CSIDriver: csi-hostpath-snapshotting-3931 Jun 18 07:07:52.488: INFO: deleting *v1.ServiceAccount: snapshotting-3931-2623/csi-hostpathplugin-sa Jun 18 07:07:52.587: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-snapshotting-3931 Jun 18 07:07:52.690: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-snapshotting-3931 Jun 18 07:07:52.785: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-snapshotting-3931 Jun 18 07:07:52.886: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-snapshotting-3931 Jun 18 07:07:52.987: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-snapshotting-3931 Jun 18 07:07:53.087: INFO: deleting *v1.RoleBinding: snapshotting-3931-2623/csi-hostpathplugin-attacher-role Jun 18 07:07:53.186: INFO: deleting *v1.RoleBinding: snapshotting-3931-2623/csi-hostpathplugin-health-monitor-controller-role Jun 18 07:07:53.286: INFO: deleting *v1.RoleBinding: snapshotting-3931-2623/csi-hostpathplugin-provisioner-role Jun 18 07:07:53.386: INFO: deleting *v1.RoleBinding: snapshotting-3931-2623/csi-hostpathplugin-resizer-role Jun 18 07:07:53.486: INFO: deleting *v1.RoleBinding: snapshotting-3931-2623/csi-hostpathplugin-snapshotter-role Jun 18 07:07:53.586: INFO: deleting *v1.StatefulSet: snapshotting-3931-2623/csi-hostpathplugin Jun 18 07:07:53.687: INFO: deleting *v1.ClusterRoleBinding: psp-csi-hostpath-role-snapshotting-3931 �[1mSTEP�[0m: deleting the driver namespace: snapshotting-3931-2623 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-3931-2623". �[1mSTEP�[0m: Found 31 events. Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:37 +0000 UTC - event for csi-hostpathplugin: {statefulset-controller } SuccessfulCreate: create Pod csi-hostpathplugin-0 in StatefulSet csi-hostpathplugin successful Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:37 +0000 UTC - event for csi-hostpathplugin-0: {default-scheduler } Scheduled: Successfully assigned snapshotting-3931-2623/csi-hostpathplugin-0 to bootstrap-e2e-minion-group-d5bn Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:38 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulling: Pulling image "registry.k8s.io/sig-storage/hostpathplugin:v1.7.3" Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:39 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Created: Created container hostpath Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:39 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Started: Started container hostpath Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:39 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0" Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:39 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/hostpathplugin:v1.7.3" in 1.154037976s Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:40 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Created: Created container node-driver-registrar Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:40 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Started: Started container node-driver-registrar Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:40 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0" in 1.110567107s Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:40 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulling: Pulling image "registry.k8s.io/sig-storage/livenessprobe:v2.6.0" Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:41 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/livenessprobe:v2.6.0" in 811.521998ms Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:41 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Created: Created container liveness-probe Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:41 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Started: Started container liveness-probe Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:41 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-attacher:v3.4.0" Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:43 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-attacher:v3.4.0" in 1.721514169s Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:43 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Created: Created container csi-attacher Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:44 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-provisioner:v3.1.0" Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:44 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Started: Started container csi-attacher Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:45 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-provisioner:v3.1.0" in 1.637113039s Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:46 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Created: Created container csi-provisioner Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:46 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Started: Started container csi-provisioner Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:46 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-resizer:v1.4.0" Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:47 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-resizer:v1.4.0" in 1.410526132s Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:47 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Created: Created container csi-resizer Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:47 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1" Jun 18 07:07:53.885: INFO: At 2022-06-18 06:43:47 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Started: Started container csi-resizer Jun 18 07:07:53.885: INFO: At 2022-06-18 07:07:53 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Killing: Stopping container hostpath Jun 18 07:07:53.885: INFO: At 2022-06-18 07:07:53 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Killing: Stopping container csi-snapshotter Jun 18 07:07:53.885: INFO: At 2022-06-18 07:07:53 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Killing: Stopping container csi-resizer Jun 18 07:07:53.885: INFO: At 2022-06-18 07:07:53 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-d5bn} Killing: Stopping container csi-provisioner Jun 18 07:07:53.936: INFO: POD NODE PHASE GRACE CONDITIONS Jun 18 07:07:53.936: INFO: csi-hostpathplugin-0 bootstrap-e2e-minion-group-d5bn Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:43:37 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:43:50 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:43:50 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:43:37 +0000 UTC }] Jun 18 07:07:53.936: INFO: Jun 18 07:07:54.336: INFO: Logging node info for node bootstrap-e2e-master Jun 18 07:07:54.391: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 764be954-a567-4f02-916f-ce5a00efd5a2 10658 0 2022-06-18 05:52:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 07:04:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:37 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:37 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:37 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 07:04:37 +0000 UTC,LastTransitionTime:2022-06-18 05:52:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.44.136,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:476dc4d83f3dde8536c284cad61ff0ba,SystemUUID:476dc4d8-3f3d-de85-36c2-84cad61ff0ba,BootID:aef22f04-bc7e-4174-a5b7-27a33f86acf6,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:117361475,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 07:07:54.391: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 18 07:07:54.435: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 18 07:07:54.497: INFO: metadata-proxy-v0.1-7s94z started at 2022-06-18 05:52:25 +0000 UTC (0+2 container statuses recorded) Jun 18 07:07:54.498: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 07:07:54.498: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 07:07:54.498: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-18 05:51:33 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:54.498: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 18 07:07:54.498: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-18 05:51:34 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:54.498: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 18 07:07:54.498: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:54.498: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 18 07:07:54.498: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:54.498: INFO: Container kube-apiserver ready: true, restart count 0 Jun 18 07:07:54.498: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:54.498: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 18 07:07:54.498: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:54.498: INFO: Container kube-scheduler ready: true, restart count 0 Jun 18 07:07:54.498: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:54.498: INFO: Container etcd-container ready: true, restart count 0 Jun 18 07:07:54.498: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:54.498: INFO: Container etcd-container ready: true, restart count 0 Jun 18 07:07:54.745: INFO: Latency metrics for node bootstrap-e2e-master Jun 18 07:07:54.745: INFO: Logging node info for node bootstrap-e2e-minion-group-d5bn Jun 18 07:07:54.785: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-d5bn 424d4104-0817-4373-8508-c511cbd42736 11112 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-d5bn kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-d5bn topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 06:43:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 07:04:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 07:07:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-d5bn,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:48 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:48 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:48 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 07:04:48 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.195.245,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9894badff0283b2bf82738e3ad5d94c7,SystemUUID:9894badf-f028-3b2b-f827-38e3ad5d94c7,BootID:7a96489e-7548-4291-b5ec-4dffe1df1ef8,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 07:07:54.786: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-d5bn Jun 18 07:07:54.821: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-d5bn Jun 18 07:07:54.921: INFO: kube-proxy-bootstrap-e2e-minion-group-d5bn started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:54.921: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 07:07:54.921: INFO: metadata-proxy-v0.1-d6z5f started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 07:07:54.921: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 07:07:54.921: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 07:07:54.921: INFO: konnectivity-agent-8fmbm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:54.921: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 07:07:54.921: INFO: coredns-85bc9d67b-ggpbp started at 2022-06-18 05:52:38 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:54.921: INFO: Container coredns ready: true, restart count 0 Jun 18 07:07:55.076: INFO: Latency metrics for node bootstrap-e2e-minion-group-d5bn Jun 18 07:07:55.077: INFO: Logging node info for node bootstrap-e2e-minion-group-t6ww Jun 18 07:07:55.113: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-t6ww 5e9180b3-4ff0-4628-af58-a045ab4463b5 10999 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-t6ww kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-t6ww topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 05:54:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 07:04:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 07:07:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-t6ww,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 07:04:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.105.119.210,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bf6eeb9eea04689287c5553b652cfd,SystemUUID:23bf6eeb-9eea-0468-9287-c5553b652cfd,BootID:a71f43cc-74ef-43c7-8805-f91aadd8f915,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 07:07:55.114: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-t6ww Jun 18 07:07:55.148: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-t6ww Jun 18 07:07:55.195: INFO: metadata-proxy-v0.1-w878c started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 07:07:55.195: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 07:07:55.195: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 07:07:55.195: INFO: coredns-85bc9d67b-svgwq started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:55.195: INFO: Container coredns ready: true, restart count 0 Jun 18 07:07:55.195: INFO: kube-dns-autoscaler-5477bd659c-8dcq9 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:55.195: INFO: Container autoscaler ready: true, restart count 0 Jun 18 07:07:55.195: INFO: l7-default-backend-5f6f9745f9-x6d4r started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:55.195: INFO: Container default-http-backend ready: true, restart count 0 Jun 18 07:07:55.195: INFO: kube-proxy-bootstrap-e2e-minion-group-t6ww started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:55.195: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 07:07:55.195: INFO: volume-snapshot-controller-0 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:55.195: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 18 07:07:55.195: INFO: konnectivity-agent-g7wjm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:55.195: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 07:07:55.369: INFO: Latency metrics for node bootstrap-e2e-minion-group-t6ww Jun 18 07:07:55.370: INFO: Logging node info for node bootstrap-e2e-minion-group-wxzs Jun 18 07:07:55.406: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-wxzs ea3ba9a8-6c89-4646-b31b-38927e0b4aa7 11017 0 2022-06-18 05:52:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-wxzs kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-wxzs topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 06:18:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 07:04:27 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 07:07:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-wxzs,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 07:07:36 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 07:04:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 07:04:27 +0000 UTC,LastTransitionTime:2022-06-18 05:52:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.230.184,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6715ba26207e0d851190b6989ac9096d,SystemUUID:6715ba26-207e-0d85-1190-b6989ac9096d,BootID:5cbacacb-c39e-42cb-abc9-35d40363f85b,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:dc0301d9a43e23e389abb7690cd631f98af76ea3429259c7f5f643fd31fc0a3e registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0],SizeBytes:27914152,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 07:07:55.407: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-wxzs Jun 18 07:07:55.462: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-wxzs Jun 18 07:07:55.525: INFO: metadata-proxy-v0.1-prz9j started at 2022-06-18 05:52:21 +0000 UTC (0+2 container statuses recorded) Jun 18 07:07:55.525: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 07:07:55.525: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jun 18 07:07:55.525: INFO: konnectivity-agent-hddcn started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:55.525: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 07:07:55.525: INFO: metrics-server-v0.5.2-755d66fb57-m6k8h started at 2022-06-18 05:52:47 +0000 UTC (0+2 container statuses recorded) Jun 18 07:07:55.525: INFO: Container metrics-server ready: true, restart count 1 Jun 18 07:07:55.525: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 18 07:07:55.525: INFO: kube-proxy-bootstrap-e2e-minion-group-wxzs started at 2022-06-18 05:52:20 +0000 UTC (0+1 container statuses recorded) Jun 18 07:07:55.525: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 07:07:55.694: INFO: Latency metrics for node bootstrap-e2e-minion-group-wxzs �[1mSTEP�[0m: Waiting for namespaces [snapshotting-3931-2623] to vanish [AfterEach] [Testpattern: Ephemeral Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:187 Jun 18 07:08:01.769: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\scsi\-hostpath\]\s\[Testpattern\:\sPre\-provisioned\sSnapshot\s\(delete\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion\s\(persistent\)$'
test/e2e/storage/testsuites/snapshottable.go:278 Jun 18 06:23:56.735: VolumeSnapshot snapshot-h2h7f is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 18 06:18:27.736: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent) test/e2e/storage/testsuites/snapshottable.go:278 �[1mSTEP�[0m: Building a driver namespace object, basename snapshotting-9155 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi-hostpath driver Jun 18 06:18:28.399: INFO: creating *v1.ServiceAccount: snapshotting-9155-2266/csi-attacher Jun 18 06:18:28.436: INFO: creating *v1.ClusterRole: external-attacher-runner-snapshotting-9155 Jun 18 06:18:28.436: INFO: Define cluster role external-attacher-runner-snapshotting-9155 Jun 18 06:18:28.474: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-9155 Jun 18 06:18:28.511: INFO: creating *v1.Role: snapshotting-9155-2266/external-attacher-cfg-snapshotting-9155 Jun 18 06:18:28.548: INFO: creating *v1.RoleBinding: snapshotting-9155-2266/csi-attacher-role-cfg Jun 18 06:18:28.585: INFO: creating *v1.ServiceAccount: snapshotting-9155-2266/csi-provisioner Jun 18 06:18:28.622: INFO: creating *v1.ClusterRole: external-provisioner-runner-snapshotting-9155 Jun 18 06:18:28.622: INFO: Define cluster role external-provisioner-runner-snapshotting-9155 Jun 18 06:18:28.659: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-9155 Jun 18 06:18:28.695: INFO: creating *v1.Role: snapshotting-9155-2266/external-provisioner-cfg-snapshotting-9155 Jun 18 06:18:28.731: INFO: creating *v1.RoleBinding: snapshotting-9155-2266/csi-provisioner-role-cfg Jun 18 06:18:28.768: INFO: creating *v1.ServiceAccount: snapshotting-9155-2266/csi-snapshotter Jun 18 06:18:28.804: INFO: creating *v1.ClusterRole: external-snapshotter-runner-snapshotting-9155 Jun 18 06:18:28.804: INFO: Define cluster role external-snapshotter-runner-snapshotting-9155 Jun 18 06:18:28.842: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-snapshotting-9155 Jun 18 06:18:28.877: INFO: creating *v1.Role: snapshotting-9155-2266/external-snapshotter-leaderelection-snapshotting-9155 Jun 18 06:18:28.913: INFO: creating *v1.RoleBinding: snapshotting-9155-2266/external-snapshotter-leaderelection Jun 18 06:18:28.950: INFO: creating *v1.ServiceAccount: snapshotting-9155-2266/csi-external-health-monitor-controller Jun 18 06:18:28.986: INFO: creating *v1.ClusterRole: external-health-monitor-controller-runner-snapshotting-9155 Jun 18 06:18:28.986: INFO: Define cluster role external-health-monitor-controller-runner-snapshotting-9155 Jun 18 06:18:29.024: INFO: creating *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-snapshotting-9155 Jun 18 06:18:29.060: INFO: creating *v1.Role: snapshotting-9155-2266/external-health-monitor-controller-cfg-snapshotting-9155 Jun 18 06:18:29.101: INFO: creating *v1.RoleBinding: snapshotting-9155-2266/csi-external-health-monitor-controller-role-cfg Jun 18 06:18:29.138: INFO: creating *v1.ServiceAccount: snapshotting-9155-2266/csi-resizer Jun 18 06:18:29.176: INFO: creating *v1.ClusterRole: external-resizer-runner-snapshotting-9155 Jun 18 06:18:29.176: INFO: Define cluster role external-resizer-runner-snapshotting-9155 Jun 18 06:18:29.213: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-snapshotting-9155 Jun 18 06:18:29.262: INFO: creating *v1.Role: snapshotting-9155-2266/external-resizer-cfg-snapshotting-9155 Jun 18 06:18:29.300: INFO: creating *v1.RoleBinding: snapshotting-9155-2266/csi-resizer-role-cfg Jun 18 06:18:29.336: INFO: creating *v1.CSIDriver: csi-hostpath-snapshotting-9155 Jun 18 06:18:29.374: INFO: creating *v1.ServiceAccount: snapshotting-9155-2266/csi-hostpathplugin-sa Jun 18 06:18:29.411: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-snapshotting-9155 Jun 18 06:18:29.449: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-snapshotting-9155 Jun 18 06:18:29.487: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-snapshotting-9155 Jun 18 06:18:29.523: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-snapshotting-9155 Jun 18 06:18:29.560: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-snapshotting-9155 Jun 18 06:18:29.597: INFO: creating *v1.RoleBinding: snapshotting-9155-2266/csi-hostpathplugin-attacher-role Jun 18 06:18:29.633: INFO: creating *v1.RoleBinding: snapshotting-9155-2266/csi-hostpathplugin-health-monitor-controller-role Jun 18 06:18:29.671: INFO: creating *v1.RoleBinding: snapshotting-9155-2266/csi-hostpathplugin-provisioner-role Jun 18 06:18:29.708: INFO: creating *v1.RoleBinding: snapshotting-9155-2266/csi-hostpathplugin-resizer-role Jun 18 06:18:29.745: INFO: creating *v1.RoleBinding: snapshotting-9155-2266/csi-hostpathplugin-snapshotter-role Jun 18 06:18:29.782: INFO: creating *v1.StatefulSet: snapshotting-9155-2266/csi-hostpathplugin Jun 18 06:18:29.822: INFO: creating *v1.ClusterRoleBinding: psp-csi-hostpath-role-snapshotting-9155 Jun 18 06:18:29.896: INFO: Creating resource for dynamic PV Jun 18 06:18:29.896: INFO: Using claimSize:1Mi, test suite supported size:{ 1Mi}, driver(csi-hostpath) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-9155vvhmm �[1mSTEP�[0m: creating a claim Jun 18 06:18:29.932: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Jun 18 06:18:29.971: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [csi-hostpathxn5b9] to have phase Bound Jun 18 06:18:30.006: INFO: PersistentVolumeClaim csi-hostpathxn5b9 found but phase is Pending instead of Bound. Jun 18 06:18:32.042: INFO: PersistentVolumeClaim csi-hostpathxn5b9 found but phase is Pending instead of Bound. Jun 18 06:18:34.078: INFO: PersistentVolumeClaim csi-hostpathxn5b9 found but phase is Pending instead of Bound. Jun 18 06:18:36.115: INFO: PersistentVolumeClaim csi-hostpathxn5b9 found but phase is Pending instead of Bound. Jun 18 06:18:38.151: INFO: PersistentVolumeClaim csi-hostpathxn5b9 found but phase is Pending instead of Bound. Jun 18 06:18:40.186: INFO: PersistentVolumeClaim csi-hostpathxn5b9 found and phase=Bound (10.215802883s) �[1mSTEP�[0m: [init] starting a pod to use the claim �[1mSTEP�[0m: [init] check pod success Jun 18 06:18:40.331: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-c6h2s" in namespace "snapshotting-9155" to be "Succeeded or Failed" Jun 18 06:18:40.366: INFO: Pod "pvc-snapshottable-tester-c6h2s": Phase="Pending", Reason="", readiness=false. Elapsed: 35.272359ms Jun 18 06:18:42.404: INFO: Pod "pvc-snapshottable-tester-c6h2s": Phase="Pending", Reason="", readiness=false. Elapsed: 2.072797292s Jun 18 06:18:44.405: INFO: Pod "pvc-snapshottable-tester-c6h2s": Phase="Pending", Reason="", readiness=false. Elapsed: 4.073749928s Jun 18 06:18:46.404: INFO: Pod "pvc-snapshottable-tester-c6h2s": Phase="Pending", Reason="", readiness=false. Elapsed: 6.072939545s Jun 18 06:18:48.404: INFO: Pod "pvc-snapshottable-tester-c6h2s": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.072410075s �[1mSTEP�[0m: Saw pod success Jun 18 06:18:48.404: INFO: Pod "pvc-snapshottable-tester-c6h2s" satisfied condition "Succeeded or Failed" �[1mSTEP�[0m: [init] checking the claim Jun 18 06:18:48.439: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [csi-hostpathxn5b9] to have phase Bound Jun 18 06:18:48.474: INFO: PersistentVolumeClaim csi-hostpathxn5b9 found and phase=Bound (35.326305ms) �[1mSTEP�[0m: [init] checking the PV �[1mSTEP�[0m: [init] deleting the pod Jun 18 06:18:48.598: INFO: Pod pvc-snapshottable-tester-c6h2s has the following logs: Jun 18 06:18:48.598: INFO: Deleting pod "pvc-snapshottable-tester-c6h2s" in namespace "snapshotting-9155" Jun 18 06:18:48.641: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-c6h2s" to be fully deleted �[1mSTEP�[0m: [init] waiting until the node=bootstrap-e2e-minion-group-wxzs is not using the volume=7de5193b-eece-11ec-9981-c2e1dde590f5 Jun 18 06:18:48.713: INFO: current volumes in use: [kubernetes.io/csi/csi-hostpath-snapshotting-9155^7de5193b-eece-11ec-9981-c2e1dde590f5] Jun 18 06:18:50.751: INFO: current volumes in use: [kubernetes.io/csi/csi-hostpath-snapshotting-9155^7de5193b-eece-11ec-9981-c2e1dde590f5] Jun 18 06:18:52.789: INFO: current volumes in use: [kubernetes.io/csi/csi-hostpath-snapshotting-9155^7de5193b-eece-11ec-9981-c2e1dde590f5] Jun 18 06:18:54.826: INFO: current volumes in use: [] Jun 18 06:18:54.826: INFO: WaitUntil finished successfully after 6.149201457s �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 18 06:18:54.942: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-h2h7f to become ready Jun 18 06:18:54.987: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:18:57.023: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:18:59.060: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:01.097: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:03.134: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:05.171: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:07.207: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:09.243: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:11.284: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:13.320: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:15.358: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:17.394: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:19.484: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:21.524: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:23.559: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:25.596: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:27.633: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:29.671: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:31.707: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:33.757: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:35.794: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:37.830: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:39.873: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:41.909: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:43.945: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:45.982: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:48.019: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:50.055: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:52.092: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:54.134: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:56.170: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:19:58.207: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:00.244: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:02.282: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:04.320: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:06.359: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:08.399: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:10.435: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:12.473: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:14.509: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:16.546: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:18.583: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:20.622: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:22.662: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:24.698: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:26.735: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:28.772: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:30.811: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:32.848: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:34.884: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:36.920: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:38.956: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:40.993: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:43.031: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:45.067: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:47.105: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:49.142: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:51.179: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:53.217: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:55.317: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:57.363: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:20:59.402: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:01.439: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:03.477: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:05.514: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:07.657: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:09.694: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:11.732: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:13.768: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:15.806: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:17.843: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:19.882: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:21.918: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:23.955: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:25.993: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:28.029: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:30.069: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:32.106: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:34.143: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:36.181: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:38.218: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:40.256: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:42.293: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:44.331: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:46.368: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:48.406: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:50.444: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:52.481: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:54.520: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:56.558: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:21:58.595: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:00.632: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:02.670: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:04.706: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:06.743: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:08.779: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:10.816: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:12.855: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:14.891: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:16.928: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:18.964: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:21.001: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:23.037: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:25.074: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:27.110: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:29.152: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:31.188: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:33.225: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:35.263: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:37.300: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:39.338: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:41.375: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:43.412: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:45.449: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:47.492: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:49.530: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:51.567: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:53.606: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:55.644: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:57.681: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:22:59.720: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:01.757: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:03.794: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:05.832: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:07.875: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:09.912: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:11.949: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:13.985: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:16.022: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:18.059: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:20.095: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:22.133: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:24.171: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:26.208: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:28.245: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:30.282: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:32.319: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:34.357: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:36.394: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:38.432: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:40.469: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:42.507: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:44.545: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:46.582: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:48.620: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:50.657: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:52.698: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:54.734: INFO: VolumeSnapshot snapshot-h2h7f found but is not ready. Jun 18 06:23:56.735: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 18 06:23:56.735: INFO: Unexpected error: <*errors.errorString | 0xc003199b00>: { s: "VolumeSnapshot snapshot-h2h7f is not ready within 5m0s", } Jun 18 06:23:56.735: FAIL: VolumeSnapshot snapshot-h2h7f is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc0031966c8?}, 0xc003242470) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7fdc384f5248, 0xc0011a6c00}, 0xc0038b02a0, {{0x71fffd4, 0x28}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.4.2() test/e2e/storage/testsuites/snapshottable.go:359 +0xb7d k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24d6d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007ba680, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: updating the snapshot content deletion policy to retain [AfterEach] volume snapshot controller test/e2e/storage/testsuites/snapshottable.go:172 �[1mSTEP�[0m: Deleting pvc Jun 18 06:23:56.736: INFO: Deleting PersistentVolumeClaim "csi-hostpathxn5b9" Jun 18 06:23:56.773: INFO: Waiting up to 5m0s for PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee to get deleted Jun 18 06:23:56.808: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (35.011662ms) Jun 18 06:24:01.859: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (5.086302098s) Jun 18 06:24:06.956: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (10.183152177s) Jun 18 06:24:12.056: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (15.283701193s) Jun 18 06:24:17.106: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (20.333714118s) Jun 18 06:24:22.156: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (25.383764125s) Jun 18 06:24:27.206: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (30.433349736s) Jun 18 06:24:32.256: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (35.483418565s) Jun 18 06:24:37.306: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (40.533182783s) Jun 18 06:24:42.357: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (45.584847094s) Jun 18 06:24:47.456: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (50.683723079s) Jun 18 06:24:52.507: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (55.73459943s) Jun 18 06:24:57.607: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m0.834067031s) Jun 18 06:25:02.707: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m5.934513666s) Jun 18 06:25:07.756: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m10.98373081s) Jun 18 06:25:12.806: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m16.033841908s) Jun 18 06:25:17.856: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m21.083624374s) Jun 18 06:25:22.906: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m26.132939382s) Jun 18 06:25:27.957: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m31.184184612s) Jun 18 06:25:33.007: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m36.23449171s) Jun 18 06:25:38.106: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m41.333565648s) Jun 18 06:25:43.157: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m46.383993759s) Jun 18 06:25:48.207: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m51.434171384s) Jun 18 06:25:53.257: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (1m56.484233735s) Jun 18 06:25:58.306: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m1.533547773s) Jun 18 06:26:03.356: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m6.583579038s) Jun 18 06:26:08.406: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m11.633360392s) Jun 18 06:26:13.456: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m16.683178723s) Jun 18 06:26:18.557: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m21.784813531s) Jun 18 06:26:23.656: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m26.883278783s) Jun 18 06:26:28.706: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m31.933387217s) Jun 18 06:26:33.756: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m36.983126115s) Jun 18 06:26:38.806: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m42.033432068s) Jun 18 06:26:43.856: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m47.0834807s) Jun 18 06:26:48.956: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m52.183792353s) Jun 18 06:26:54.056: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (2m57.283395827s) Jun 18 06:26:59.161: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m2.388508617s) Jun 18 06:27:04.206: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m7.433739215s) Jun 18 06:27:09.257: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m12.484048522s) Jun 18 06:27:14.356: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m17.583305876s) Jun 18 06:27:19.406: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m22.633286165s) Jun 18 06:27:24.460: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m27.687370955s) Jun 18 06:27:29.556: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m32.783520106s) Jun 18 06:27:34.606: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m37.833181204s) Jun 18 06:27:39.656: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m42.883529233s) Jun 18 06:27:44.707: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m47.933968728s) Jun 18 06:27:49.756: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m52.983119181s) Jun 18 06:27:54.805: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (3m58.032875619s) Jun 18 06:27:59.856: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m3.083612161s) Jun 18 06:28:04.906: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m8.133227844s) Jun 18 06:28:09.955: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m13.182876754s) Jun 18 06:28:15.006: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m18.233506882s) Jun 18 06:28:20.056: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m23.283331076s) Jun 18 06:28:25.157: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m28.384676834s) Jun 18 06:28:30.257: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m33.484537363s) Jun 18 06:28:35.356: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m38.583389039s) Jun 18 06:28:40.407: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m43.633946703s) Jun 18 06:28:45.506: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m48.733243041s) Jun 18 06:28:50.557: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m53.784096538s) Jun 18 06:28:55.655: INFO: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee found and phase=Bound (4m58.882756419s) �[1mSTEP�[0m: Deleting sc Jun 18 06:29:00.709: INFO: Unexpected error: <errors.aggregate | len:1, cap:1>: [ { msg: "persistent Volume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee not deleted by dynamic provisioner: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee still exists within 5m0s", err: { s: "PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee still exists within 5m0s", }, }, ] Jun 18 06:29:00.709: FAIL: persistent Volume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee not deleted by dynamic provisioner: PersistentVolume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee still exists within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.1.1() test/e2e/storage/testsuites/snapshottable.go:142 +0x3c k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0xc0004fe8c0?) test/e2e/storage/utils/utils.go:714 +0x6d k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.2() test/e2e/storage/testsuites/snapshottable.go:167 +0x38 k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.3() test/e2e/storage/testsuites/snapshottable.go:173 +0x1b k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24d6d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007ba680, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: deleting the test namespace: snapshotting-9155 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-9155". �[1mSTEP�[0m: Found 11 events. Jun 18 06:29:00.807: INFO: At 2022-06-18 06:18:29 +0000 UTC - event for csi-hostpathxn5b9: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "csi-hostpath-snapshotting-9155" or manually created by system administrator Jun 18 06:29:00.807: INFO: At 2022-06-18 06:18:38 +0000 UTC - event for csi-hostpathxn5b9: {csi-hostpath-snapshotting-9155_csi-hostpathplugin-0_91d3a04d-b315-4cd7-8b44-591b6dfdd1e9 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-9155/csi-hostpathxn5b9" Jun 18 06:29:00.807: INFO: At 2022-06-18 06:18:38 +0000 UTC - event for csi-hostpathxn5b9: {csi-hostpath-snapshotting-9155_csi-hostpathplugin-0_91d3a04d-b315-4cd7-8b44-591b6dfdd1e9 } ProvisioningSucceeded: Successfully provisioned volume pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee Jun 18 06:29:00.807: INFO: At 2022-06-18 06:18:40 +0000 UTC - event for pvc-snapshottable-tester-c6h2s: {default-scheduler } Scheduled: Successfully assigned snapshotting-9155/pvc-snapshottable-tester-c6h2s to bootstrap-e2e-minion-group-wxzs Jun 18 06:29:00.807: INFO: At 2022-06-18 06:18:40 +0000 UTC - event for pvc-snapshottable-tester-c6h2s: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-2b5df5e4-d2af-43d1-a50d-d725d58742ee" Jun 18 06:29:00.807: INFO: At 2022-06-18 06:18:44 +0000 UTC - event for pvc-snapshottable-tester-c6h2s: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/e2e-test-images/busybox:1.29-2" Jun 18 06:29:00.807: INFO: At 2022-06-18 06:18:45 +0000 UTC - event for pvc-snapshottable-tester-c6h2s: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/busybox:1.29-2" in 567.250888ms Jun 18 06:29:00.807: INFO: At 2022-06-18 06:18:45 +0000 UTC - event for pvc-snapshottable-tester-c6h2s: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container volume-tester Jun 18 06:29:00.807: INFO: At 2022-06-18 06:18:45 +0000 UTC - event for pvc-snapshottable-tester-c6h2s: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container volume-tester Jun 18 06:29:00.807: INFO: At 2022-06-18 06:18:54 +0000 UTC - event for snapshot-h2h7f: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-9155/snapshot-h2h7f to be created by the CSI driver. Jun 18 06:29:00.807: INFO: At 2022-06-18 06:18:54 +0000 UTC - event for snapshot-h2h7f: {snapshot-controller } SnapshotFinalizerError: Failed to check and update snapshot: snapshot controller failed to update snapshotting-9155/snapshot-h2h7f on API server: volumesnapshots.snapshot.storage.k8s.io "snapshot-h2h7f" is forbidden: User "system:serviceaccount:kube-system:volume-snapshot-controller" cannot patch resource "volumesnapshots" in API group "snapshot.storage.k8s.io" in the namespace "snapshotting-9155" Jun 18 06:29:00.906: INFO: POD NODE PHASE GRACE CONDITIONS Jun 18 06:29:00.906: INFO: Jun 18 06:29:01.010: INFO: Logging node info for node bootstrap-e2e-master Jun 18 06:29:01.107: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 764be954-a567-4f02-916f-ce5a00efd5a2 5288 0 2022-06-18 05:52:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:28:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:42 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:42 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:42 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:28:42 +0000 UTC,LastTransitionTime:2022-06-18 05:52:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.44.136,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:476dc4d83f3dde8536c284cad61ff0ba,SystemUUID:476dc4d8-3f3d-de85-36c2-84cad61ff0ba,BootID:aef22f04-bc7e-4174-a5b7-27a33f86acf6,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:117361475,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:29:01.108: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 18 06:29:01.209: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 18 06:29:01.331: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:01.331: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 18 06:29:01.331: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:01.331: INFO: Container kube-scheduler ready: true, restart count 0 Jun 18 06:29:01.331: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:01.331: INFO: Container etcd-container ready: true, restart count 0 Jun 18 06:29:01.331: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:01.331: INFO: Container etcd-container ready: true, restart count 0 Jun 18 06:29:01.331: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-18 05:51:33 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:01.331: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 18 06:29:01.331: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-18 05:51:34 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:01.331: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 18 06:29:01.331: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:01.331: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 18 06:29:01.331: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:01.331: INFO: Container kube-apiserver ready: true, restart count 0 Jun 18 06:29:01.331: INFO: metadata-proxy-v0.1-7s94z started at 2022-06-18 05:52:25 +0000 UTC (0+2 container statuses recorded) Jun 18 06:29:01.331: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:29:01.331: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:29:01.696: INFO: Latency metrics for node bootstrap-e2e-master Jun 18 06:29:01.696: INFO: Logging node info for node bootstrap-e2e-minion-group-d5bn Jun 18 06:29:01.759: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-d5bn 424d4104-0817-4373-8508-c511cbd42736 5267 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-d5bn kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-18 06:27:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-18 06:28:32 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-d5bn,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:27:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:27:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:27:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:27:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:27:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:27:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:27:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:32 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:32 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:32 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:28:32 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.195.245,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9894badff0283b2bf82738e3ad5d94c7,SystemUUID:9894badf-f028-3b2b-f827-38e3ad5d94c7,BootID:7a96489e-7548-4291-b5ec-4dffe1df1ef8,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:29:01.759: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-d5bn Jun 18 06:29:01.858: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-d5bn Jun 18 06:29:01.986: INFO: coredns-85bc9d67b-ggpbp started at 2022-06-18 05:52:38 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:01.986: INFO: Container coredns ready: true, restart count 0 Jun 18 06:29:01.986: INFO: kube-proxy-bootstrap-e2e-minion-group-d5bn started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:01.986: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:29:01.986: INFO: metadata-proxy-v0.1-d6z5f started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 06:29:01.986: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:29:01.986: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:29:01.986: INFO: konnectivity-agent-8fmbm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:01.986: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:29:02.298: INFO: Latency metrics for node bootstrap-e2e-minion-group-d5bn Jun 18 06:29:02.298: INFO: Logging node info for node bootstrap-e2e-minion-group-t6ww Jun 18 06:29:02.357: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-t6ww 5e9180b3-4ff0-4628-af58-a045ab4463b5 5134 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-t6ww kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-t6ww topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 05:54:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:25:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 06:27:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-t6ww,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:27:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:27:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:27:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:27:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:27:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:27:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:27:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:25:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:25:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:25:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:25:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.105.119.210,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bf6eeb9eea04689287c5553b652cfd,SystemUUID:23bf6eeb-9eea-0468-9287-c5553b652cfd,BootID:a71f43cc-74ef-43c7-8805-f91aadd8f915,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:29:02.358: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-t6ww Jun 18 06:29:02.459: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-t6ww Jun 18 06:29:02.592: INFO: coredns-85bc9d67b-svgwq started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:02.592: INFO: Container coredns ready: true, restart count 0 Jun 18 06:29:02.592: INFO: kube-dns-autoscaler-5477bd659c-8dcq9 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:02.592: INFO: Container autoscaler ready: true, restart count 0 Jun 18 06:29:02.592: INFO: l7-default-backend-5f6f9745f9-x6d4r started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:02.592: INFO: Container default-http-backend ready: true, restart count 0 Jun 18 06:29:02.592: INFO: metadata-proxy-v0.1-w878c started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 06:29:02.592: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:29:02.592: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:29:02.592: INFO: volume-snapshot-controller-0 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:02.592: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 18 06:29:02.592: INFO: konnectivity-agent-g7wjm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:02.592: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:29:02.592: INFO: kube-proxy-bootstrap-e2e-minion-group-t6ww started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:02.592: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:29:02.934: INFO: Latency metrics for node bootstrap-e2e-minion-group-t6ww Jun 18 06:29:02.934: INFO: Logging node info for node bootstrap-e2e-minion-group-wxzs Jun 18 06:29:03.007: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-wxzs ea3ba9a8-6c89-4646-b31b-38927e0b4aa7 5143 0 2022-06-18 05:52:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-wxzs kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-wxzs topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-snapshotting-9155":"bootstrap-e2e-minion-group-wxzs"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 06:18:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:24:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 06:27:28 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-wxzs,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:27:28 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:27:28 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:27:28 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:27:28 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:27:28 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:27:28 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:27:28 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:24:01 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:24:01 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:24:01 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:24:01 +0000 UTC,LastTransitionTime:2022-06-18 05:52:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.230.184,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6715ba26207e0d851190b6989ac9096d,SystemUUID:6715ba26-207e-0d85-1190-b6989ac9096d,BootID:5cbacacb-c39e-42cb-abc9-35d40363f85b,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:29:03.007: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-wxzs Jun 18 06:29:03.108: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-wxzs Jun 18 06:29:03.232: INFO: konnectivity-agent-hddcn started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:03.232: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:29:03.232: INFO: metrics-server-v0.5.2-755d66fb57-m6k8h started at 2022-06-18 05:52:47 +0000 UTC (0+2 container statuses recorded) Jun 18 06:29:03.232: INFO: Container metrics-server ready: true, restart count 1 Jun 18 06:29:03.232: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 18 06:29:03.232: INFO: csi-hostpathplugin-0 started at 2022-06-18 06:18:29 +0000 UTC (0+7 container statuses recorded) Jun 18 06:29:03.232: INFO: Container csi-attacher ready: true, restart count 0 Jun 18 06:29:03.232: INFO: Container csi-provisioner ready: true, restart count 0 Jun 18 06:29:03.232: INFO: Container csi-resizer ready: true, restart count 0 Jun 18 06:29:03.232: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 18 06:29:03.232: INFO: Container hostpath ready: true, restart count 0 Jun 18 06:29:03.232: INFO: Container liveness-probe ready: true, restart count 0 Jun 18 06:29:03.232: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 18 06:29:03.232: INFO: kube-proxy-bootstrap-e2e-minion-group-wxzs started at 2022-06-18 05:52:20 +0000 UTC (0+1 container statuses recorded) Jun 18 06:29:03.232: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:29:03.232: INFO: metadata-proxy-v0.1-prz9j started at 2022-06-18 05:52:21 +0000 UTC (0+2 container statuses recorded) Jun 18 06:29:03.232: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:29:03.232: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jun 18 06:29:03.585: INFO: Latency metrics for node bootstrap-e2e-minion-group-wxzs �[1mSTEP�[0m: Waiting for namespaces [snapshotting-9155] to vanish �[1mSTEP�[0m: uninstalling csi csi-hostpath driver Jun 18 06:33:13.757: INFO: deleting *v1.ServiceAccount: snapshotting-9155-2266/csi-attacher Jun 18 06:33:13.858: INFO: deleting *v1.ClusterRole: external-attacher-runner-snapshotting-9155 Jun 18 06:33:13.958: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-9155 Jun 18 06:33:14.057: INFO: deleting *v1.Role: snapshotting-9155-2266/external-attacher-cfg-snapshotting-9155 Jun 18 06:33:14.183: INFO: deleting *v1.RoleBinding: snapshotting-9155-2266/csi-attacher-role-cfg Jun 18 06:33:14.259: INFO: deleting *v1.ServiceAccount: snapshotting-9155-2266/csi-provisioner Jun 18 06:33:14.359: INFO: deleting *v1.ClusterRole: external-provisioner-runner-snapshotting-9155 Jun 18 06:33:14.459: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-9155 Jun 18 06:33:14.559: INFO: deleting *v1.Role: snapshotting-9155-2266/external-provisioner-cfg-snapshotting-9155 Jun 18 06:33:14.657: INFO: deleting *v1.RoleBinding: snapshotting-9155-2266/csi-provisioner-role-cfg Jun 18 06:33:14.757: INFO: deleting *v1.ServiceAccount: snapshotting-9155-2266/csi-snapshotter Jun 18 06:33:14.857: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-snapshotting-9155 Jun 18 06:33:14.957: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-snapshotting-9155 Jun 18 06:33:15.057: INFO: deleting *v1.Role: snapshotting-9155-2266/external-snapshotter-leaderelection-snapshotting-9155 Jun 18 06:33:15.157: INFO: deleting *v1.RoleBinding: snapshotting-9155-2266/external-snapshotter-leaderelection Jun 18 06:33:15.258: INFO: deleting *v1.ServiceAccount: snapshotting-9155-2266/csi-external-health-monitor-controller Jun 18 06:33:15.358: INFO: deleting *v1.ClusterRole: external-health-monitor-controller-runner-snapshotting-9155 Jun 18 06:33:15.461: INFO: deleting *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-snapshotting-9155 Jun 18 06:33:15.558: INFO: deleting *v1.Role: snapshotting-9155-2266/external-health-monitor-controller-cfg-snapshotting-9155 Jun 18 06:33:15.663: INFO: deleting *v1.RoleBinding: snapshotting-9155-2266/csi-external-health-monitor-controller-role-cfg Jun 18 06:33:15.759: INFO: deleting *v1.ServiceAccount: snapshotting-9155-2266/csi-resizer Jun 18 06:33:15.860: INFO: deleting *v1.ClusterRole: external-resizer-runner-snapshotting-9155 Jun 18 06:33:15.958: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-snapshotting-9155 Jun 18 06:33:16.058: INFO: deleting *v1.Role: snapshotting-9155-2266/external-resizer-cfg-snapshotting-9155 Jun 18 06:33:16.158: INFO: deleting *v1.RoleBinding: snapshotting-9155-2266/csi-resizer-role-cfg Jun 18 06:33:16.258: INFO: deleting *v1.CSIDriver: csi-hostpath-snapshotting-9155 Jun 18 06:33:16.358: INFO: deleting *v1.ServiceAccount: snapshotting-9155-2266/csi-hostpathplugin-sa Jun 18 06:33:16.459: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-snapshotting-9155 Jun 18 06:33:16.559: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-snapshotting-9155 Jun 18 06:33:16.658: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-snapshotting-9155 Jun 18 06:33:16.759: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-snapshotting-9155 Jun 18 06:33:16.857: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-snapshotting-9155 Jun 18 06:33:16.958: INFO: deleting *v1.RoleBinding: snapshotting-9155-2266/csi-hostpathplugin-attacher-role Jun 18 06:33:17.057: INFO: deleting *v1.RoleBinding: snapshotting-9155-2266/csi-hostpathplugin-health-monitor-controller-role Jun 18 06:33:17.157: INFO: deleting *v1.RoleBinding: snapshotting-9155-2266/csi-hostpathplugin-provisioner-role Jun 18 06:33:17.258: INFO: deleting *v1.RoleBinding: snapshotting-9155-2266/csi-hostpathplugin-resizer-role Jun 18 06:33:17.360: INFO: deleting *v1.RoleBinding: snapshotting-9155-2266/csi-hostpathplugin-snapshotter-role Jun 18 06:33:17.459: INFO: deleting *v1.StatefulSet: snapshotting-9155-2266/csi-hostpathplugin Jun 18 06:33:17.562: INFO: deleting *v1.ClusterRoleBinding: psp-csi-hostpath-role-snapshotting-9155 �[1mSTEP�[0m: deleting the driver namespace: snapshotting-9155-2266 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-9155-2266". �[1mSTEP�[0m: Found 29 events. Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:29 +0000 UTC - event for csi-hostpathplugin: {statefulset-controller } SuccessfulCreate: create Pod csi-hostpathplugin-0 in StatefulSet csi-hostpathplugin successful Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:29 +0000 UTC - event for csi-hostpathplugin-0: {default-scheduler } Scheduled: Successfully assigned snapshotting-9155-2266/csi-hostpathplugin-0 to bootstrap-e2e-minion-group-wxzs Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:30 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/sig-storage/hostpathplugin:v1.7.3" Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:31 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container hostpath Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:31 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container hostpath Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:31 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0" Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:31 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/hostpathplugin:v1.7.3" in 1.172585501s Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:32 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0" in 1.23929469s Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:33 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container node-driver-registrar Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:33 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/sig-storage/livenessprobe:v2.6.0" Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:33 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container node-driver-registrar Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:34 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/livenessprobe:v2.6.0" in 902.820087ms Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:34 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container liveness-probe Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:34 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container liveness-probe Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:34 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-attacher:v3.4.0" Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:35 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-attacher:v3.4.0" in 1.509867975s Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:36 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container csi-attacher Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:36 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-provisioner:v3.1.0" Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:36 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container csi-attacher Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:37 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-provisioner:v3.1.0" in 1.554322077s Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:38 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container csi-provisioner Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:38 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container csi-provisioner Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:38 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-resizer:v1.4.0" Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:39 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container csi-resizer Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:39 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container csi-resizer Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:39 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1" Jun 18 06:33:17.759: INFO: At 2022-06-18 06:18:39 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-resizer:v1.4.0" in 1.385031035s Jun 18 06:33:17.759: INFO: At 2022-06-18 06:33:17 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Killing: Stopping container hostpath Jun 18 06:33:17.759: INFO: At 2022-06-18 06:33:17 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-wxzs} Killing: Stopping container csi-snapshotter Jun 18 06:33:17.808: INFO: POD NODE PHASE GRACE CONDITIONS Jun 18 06:33:17.808: INFO: csi-hostpathplugin-0 bootstrap-e2e-minion-group-wxzs Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:18:29 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:18:42 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:18:42 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:18:29 +0000 UTC }] Jun 18 06:33:17.808: INFO: Jun 18 06:33:18.217: INFO: Logging node info for node bootstrap-e2e-master Jun 18 06:33:18.257: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 764be954-a567-4f02-916f-ce5a00efd5a2 5288 0 2022-06-18 05:52:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:28:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:42 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:42 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:42 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:28:42 +0000 UTC,LastTransitionTime:2022-06-18 05:52:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.44.136,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:476dc4d83f3dde8536c284cad61ff0ba,SystemUUID:476dc4d8-3f3d-de85-36c2-84cad61ff0ba,BootID:aef22f04-bc7e-4174-a5b7-27a33f86acf6,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:117361475,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:33:18.258: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 18 06:33:18.316: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 18 06:33:18.374: INFO: metadata-proxy-v0.1-7s94z started at 2022-06-18 05:52:25 +0000 UTC (0+2 container statuses recorded) Jun 18 06:33:18.374: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:33:18.374: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:33:18.374: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.374: INFO: Container kube-apiserver ready: true, restart count 0 Jun 18 06:33:18.374: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.374: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 18 06:33:18.374: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.374: INFO: Container kube-scheduler ready: true, restart count 0 Jun 18 06:33:18.374: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.374: INFO: Container etcd-container ready: true, restart count 0 Jun 18 06:33:18.374: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.374: INFO: Container etcd-container ready: true, restart count 0 Jun 18 06:33:18.374: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-18 05:51:33 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.375: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 18 06:33:18.375: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-18 05:51:34 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.375: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 18 06:33:18.375: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.375: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 18 06:33:18.557: INFO: Latency metrics for node bootstrap-e2e-master Jun 18 06:33:18.558: INFO: Logging node info for node bootstrap-e2e-minion-group-d5bn Jun 18 06:33:18.596: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-d5bn 424d4104-0817-4373-8508-c511cbd42736 5743 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-d5bn kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:28:32 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 06:32:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-d5bn,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:32:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:32:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:32:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:32:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:32:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:32:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:32:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:32 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:32 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:28:32 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:28:32 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.195.245,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9894badff0283b2bf82738e3ad5d94c7,SystemUUID:9894badf-f028-3b2b-f827-38e3ad5d94c7,BootID:7a96489e-7548-4291-b5ec-4dffe1df1ef8,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:33:18.598: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-d5bn Jun 18 06:33:18.636: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-d5bn Jun 18 06:33:18.691: INFO: coredns-85bc9d67b-ggpbp started at 2022-06-18 05:52:38 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.691: INFO: Container coredns ready: true, restart count 0 Jun 18 06:33:18.691: INFO: kube-proxy-bootstrap-e2e-minion-group-d5bn started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.691: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:33:18.691: INFO: metadata-proxy-v0.1-d6z5f started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 06:33:18.691: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:33:18.691: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:33:18.691: INFO: konnectivity-agent-8fmbm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.691: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:33:18.859: INFO: Latency metrics for node bootstrap-e2e-minion-group-d5bn Jun 18 06:33:18.859: INFO: Logging node info for node bootstrap-e2e-minion-group-t6ww Jun 18 06:33:18.896: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-t6ww 5e9180b3-4ff0-4628-af58-a045ab4463b5 5741 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-t6ww kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-t6ww topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 05:54:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:30:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 06:32:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-t6ww,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:32:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:32:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:32:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:32:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:32:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:32:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:32:25 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:30:35 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:30:35 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:30:35 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:30:35 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.105.119.210,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bf6eeb9eea04689287c5553b652cfd,SystemUUID:23bf6eeb-9eea-0468-9287-c5553b652cfd,BootID:a71f43cc-74ef-43c7-8805-f91aadd8f915,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:33:18.896: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-t6ww Jun 18 06:33:18.938: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-t6ww Jun 18 06:33:18.994: INFO: kube-dns-autoscaler-5477bd659c-8dcq9 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.994: INFO: Container autoscaler ready: true, restart count 0 Jun 18 06:33:18.994: INFO: l7-default-backend-5f6f9745f9-x6d4r started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.994: INFO: Container default-http-backend ready: true, restart count 0 Jun 18 06:33:18.994: INFO: metadata-proxy-v0.1-w878c started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 06:33:18.994: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:33:18.994: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:33:18.994: INFO: coredns-85bc9d67b-svgwq started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.994: INFO: Container coredns ready: true, restart count 0 Jun 18 06:33:18.994: INFO: volume-snapshot-controller-0 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.994: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 18 06:33:18.994: INFO: konnectivity-agent-g7wjm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.994: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:33:18.994: INFO: kube-proxy-bootstrap-e2e-minion-group-t6ww started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:18.994: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:33:19.157: INFO: Latency metrics for node bootstrap-e2e-minion-group-t6ww Jun 18 06:33:19.157: INFO: Logging node info for node bootstrap-e2e-minion-group-wxzs Jun 18 06:33:19.194: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-wxzs ea3ba9a8-6c89-4646-b31b-38927e0b4aa7 5895 0 2022-06-18 05:52:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-wxzs kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-wxzs topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 06:18:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:29:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 06:32:29 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-wxzs,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:32:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:32:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:32:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:32:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:32:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:32:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:32:29 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:29:07 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:29:07 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:29:07 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:29:07 +0000 UTC,LastTransitionTime:2022-06-18 05:52:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.230.184,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6715ba26207e0d851190b6989ac9096d,SystemUUID:6715ba26-207e-0d85-1190-b6989ac9096d,BootID:5cbacacb-c39e-42cb-abc9-35d40363f85b,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:33:19.194: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-wxzs Jun 18 06:33:19.236: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-wxzs Jun 18 06:33:19.280: INFO: konnectivity-agent-hddcn started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:19.280: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:33:19.280: INFO: metrics-server-v0.5.2-755d66fb57-m6k8h started at 2022-06-18 05:52:47 +0000 UTC (0+2 container statuses recorded) Jun 18 06:33:19.280: INFO: Container metrics-server ready: true, restart count 1 Jun 18 06:33:19.280: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 18 06:33:19.280: INFO: kube-proxy-bootstrap-e2e-minion-group-wxzs started at 2022-06-18 05:52:20 +0000 UTC (0+1 container statuses recorded) Jun 18 06:33:19.280: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:33:19.280: INFO: metadata-proxy-v0.1-prz9j started at 2022-06-18 05:52:21 +0000 UTC (0+2 container statuses recorded) Jun 18 06:33:19.280: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:33:19.280: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jun 18 06:33:19.447: INFO: Latency metrics for node bootstrap-e2e-minion-group-wxzs �[1mSTEP�[0m: Waiting for namespaces [snapshotting-9155-2266] to vanish [AfterEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:187 Jun 18 06:33:25.522: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\spd\.csi\.storage\.gke\.io\]\[Serial\]\s\[Testpattern\:\sPre\-provisioned\sSnapshot\s\(retain\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion\s\(persistent\)$'
test/e2e/storage/testsuites/snapshottable.go:278 Jun 18 06:42:43.626: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e is not ready within 5m0s test/e2e/storage/framework/snapshot_resource.go:156from junit_01.xml
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 18 06:33:26.259: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent) test/e2e/storage/testsuites/snapshottable.go:278 �[1mSTEP�[0m: deploying csi gce-pd driver �[1mSTEP�[0m: Building a driver namespace object, basename snapshotting-5417 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace Jun 18 06:33:26.792: INFO: Found CI service account key at /etc/service-account/service-account.json Jun 18 06:33:26.792: INFO: Running cp [/etc/service-account/service-account.json /tmp/93ca6bd1-d0dd-4653-80e1-c6c47411a88c/cloud-sa.json] Jun 18 06:33:26.832: INFO: Shredding file /tmp/93ca6bd1-d0dd-4653-80e1-c6c47411a88c/cloud-sa.json Jun 18 06:33:26.832: INFO: Running shred [--remove /tmp/93ca6bd1-d0dd-4653-80e1-c6c47411a88c/cloud-sa.json] Jun 18 06:33:26.864: INFO: File /tmp/93ca6bd1-d0dd-4653-80e1-c6c47411a88c/cloud-sa.json successfully shredded Jun 18 06:33:26.872: INFO: creating *v1.ServiceAccount: snapshotting-5417-3753/csi-attacher Jun 18 06:33:26.909: INFO: creating *v1.ClusterRole: external-attacher-runner-snapshotting-5417 Jun 18 06:33:26.909: INFO: Define cluster role external-attacher-runner-snapshotting-5417 Jun 18 06:33:26.948: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-5417 Jun 18 06:33:26.985: INFO: creating *v1.Role: snapshotting-5417-3753/external-attacher-cfg-snapshotting-5417 Jun 18 06:33:27.022: INFO: creating *v1.RoleBinding: snapshotting-5417-3753/csi-attacher-role-cfg Jun 18 06:33:27.059: INFO: creating *v1.ServiceAccount: snapshotting-5417-3753/csi-provisioner Jun 18 06:33:27.096: INFO: creating *v1.ClusterRole: external-provisioner-runner-snapshotting-5417 Jun 18 06:33:27.096: INFO: Define cluster role external-provisioner-runner-snapshotting-5417 Jun 18 06:33:27.135: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-5417 Jun 18 06:33:27.172: INFO: creating *v1.Role: snapshotting-5417-3753/external-provisioner-cfg-snapshotting-5417 Jun 18 06:33:27.209: INFO: creating *v1.RoleBinding: snapshotting-5417-3753/csi-provisioner-role-cfg Jun 18 06:33:27.246: INFO: creating *v1.ServiceAccount: snapshotting-5417-3753/csi-gce-pd-controller-sa Jun 18 06:33:27.283: INFO: creating *v1.ClusterRole: csi-gce-pd-provisioner-role-snapshotting-5417 Jun 18 06:33:27.283: INFO: Define cluster role csi-gce-pd-provisioner-role-snapshotting-5417 Jun 18 06:33:27.320: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-provisioner-binding-snapshotting-5417 Jun 18 06:33:27.356: INFO: creating *v1.ClusterRole: csi-gce-pd-attacher-role-snapshotting-5417 Jun 18 06:33:27.356: INFO: Define cluster role csi-gce-pd-attacher-role-snapshotting-5417 Jun 18 06:33:27.394: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-attacher-binding-snapshotting-5417 Jun 18 06:33:27.431: INFO: creating *v1.ClusterRole: csi-gce-pd-resizer-role-snapshotting-5417 Jun 18 06:33:27.431: INFO: Define cluster role csi-gce-pd-resizer-role-snapshotting-5417 Jun 18 06:33:27.470: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-resizer-binding-snapshotting-5417 Jun 18 06:33:27.508: INFO: creating *v1.ClusterRole: csi-gce-pd-snapshotter-role-snapshotting-5417 Jun 18 06:33:27.508: INFO: Define cluster role csi-gce-pd-snapshotter-role-snapshotting-5417 Jun 18 06:33:27.547: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-snapshotter-binding-snapshotting-5417 Jun 18 06:33:27.585: INFO: creating *v1.Role: snapshotting-5417-3753/csi-gce-pd-leaderelection-role-snapshotting-5417 Jun 18 06:33:27.622: INFO: creating *v1.RoleBinding: snapshotting-5417-3753/csi-gce-pd-controller-leaderelection-binding Jun 18 06:33:27.660: INFO: creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-snapshotting-5417 Jun 18 06:33:27.698: INFO: creating *v1.DaemonSet: snapshotting-5417-3753/csi-gce-pd-node Jun 18 06:33:27.738: INFO: creating *v1.StatefulSet: snapshotting-5417-3753/csi-gce-pd-controller Jun 18 06:33:27.928: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-d5bn Jun 18 06:33:37.622: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-t6ww Jun 18 06:33:37.658: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-wxzs Jun 18 06:33:42.776: INFO: Creating resource for dynamic PV Jun 18 06:33:42.776: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(pd.csi.storage.gke.io) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-5417lzbqr �[1mSTEP�[0m: creating a claim Jun 18 06:33:42.813: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: [init] starting a pod to use the claim �[1mSTEP�[0m: [init] check pod success Jun 18 06:33:42.961: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-ktfcz" in namespace "snapshotting-5417" to be "Succeeded or Failed" Jun 18 06:33:42.997: INFO: Pod "pvc-snapshottable-tester-ktfcz": Phase="Pending", Reason="", readiness=false. Elapsed: 35.31506ms Jun 18 06:33:45.033: INFO: Pod "pvc-snapshottable-tester-ktfcz": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071464972s Jun 18 06:33:47.036: INFO: Pod "pvc-snapshottable-tester-ktfcz": Phase="Pending", Reason="", readiness=false. Elapsed: 4.074578206s Jun 18 06:33:49.033: INFO: Pod "pvc-snapshottable-tester-ktfcz": Phase="Pending", Reason="", readiness=false. Elapsed: 6.071967003s Jun 18 06:33:51.033: INFO: Pod "pvc-snapshottable-tester-ktfcz": Phase="Pending", Reason="", readiness=false. Elapsed: 8.0715057s Jun 18 06:33:53.033: INFO: Pod "pvc-snapshottable-tester-ktfcz": Phase="Pending", Reason="", readiness=false. Elapsed: 10.071573957s Jun 18 06:33:55.033: INFO: Pod "pvc-snapshottable-tester-ktfcz": Phase="Pending", Reason="", readiness=false. Elapsed: 12.071525227s Jun 18 06:33:57.032: INFO: Pod "pvc-snapshottable-tester-ktfcz": Phase="Pending", Reason="", readiness=false. Elapsed: 14.070920634s Jun 18 06:33:59.034: INFO: Pod "pvc-snapshottable-tester-ktfcz": Phase="Pending", Reason="", readiness=false. Elapsed: 16.072397006s Jun 18 06:34:01.034: INFO: Pod "pvc-snapshottable-tester-ktfcz": Phase="Pending", Reason="", readiness=false. Elapsed: 18.072675391s Jun 18 06:34:03.034: INFO: Pod "pvc-snapshottable-tester-ktfcz": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.07232689s �[1mSTEP�[0m: Saw pod success Jun 18 06:34:03.034: INFO: Pod "pvc-snapshottable-tester-ktfcz" satisfied condition "Succeeded or Failed" �[1mSTEP�[0m: [init] checking the claim Jun 18 06:34:03.069: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pd.csi.storage.gke.io974j9] to have phase Bound Jun 18 06:34:03.105: INFO: PersistentVolumeClaim pd.csi.storage.gke.io974j9 found and phase=Bound (35.731014ms) �[1mSTEP�[0m: [init] checking the PV �[1mSTEP�[0m: [init] deleting the pod Jun 18 06:34:03.236: INFO: Pod pvc-snapshottable-tester-ktfcz has the following logs: Jun 18 06:34:03.236: INFO: Deleting pod "pvc-snapshottable-tester-ktfcz" in namespace "snapshotting-5417" Jun 18 06:34:03.279: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-ktfcz" to be fully deleted �[1mSTEP�[0m: [init] waiting until the node=bootstrap-e2e-minion-group-d5bn is not using the volume=projects/kubernetes-gci-scale/zones/us-west1-b/disks/pvc-80a7fc37-dd0c-44b0-8736-46ed132f5c1d Jun 18 06:34:03.351: INFO: current volumes in use: [kubernetes.io/csi/pd.csi.storage.gke.io^projects/kubernetes-gci-scale/zones/us-west1-b/disks/pvc-80a7fc37-dd0c-44b0-8736-46ed132f5c1d] Jun 18 06:34:05.389: INFO: current volumes in use: [kubernetes.io/csi/pd.csi.storage.gke.io^projects/kubernetes-gci-scale/zones/us-west1-b/disks/pvc-80a7fc37-dd0c-44b0-8736-46ed132f5c1d] Jun 18 06:34:07.426: INFO: current volumes in use: [kubernetes.io/csi/pd.csi.storage.gke.io^projects/kubernetes-gci-scale/zones/us-west1-b/disks/pvc-80a7fc37-dd0c-44b0-8736-46ed132f5c1d] Jun 18 06:34:09.463: INFO: current volumes in use: [kubernetes.io/csi/pd.csi.storage.gke.io^projects/kubernetes-gci-scale/zones/us-west1-b/disks/pvc-80a7fc37-dd0c-44b0-8736-46ed132f5c1d] Jun 18 06:34:11.500: INFO: current volumes in use: [] Jun 18 06:34:11.500: INFO: WaitUntil finished successfully after 8.185404423s �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 18 06:34:11.613: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-6gktm to become ready Jun 18 06:34:11.655: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:13.692: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:15.729: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:17.773: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:19.813: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:21.853: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:23.889: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:25.926: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:27.963: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:29.999: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:32.036: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:34.072: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:36.109: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:38.146: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:40.184: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:42.221: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:44.259: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:46.297: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:48.334: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:50.371: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:52.409: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:54.448: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:56.485: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:34:58.524: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:00.561: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:02.599: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:04.638: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:06.674: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:08.711: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:10.748: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:12.785: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:14.822: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:16.859: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:18.897: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:20.933: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:22.970: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:25.007: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:27.045: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:29.081: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:31.119: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:33.163: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:35.200: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:37.237: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:39.275: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:41.312: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:43.349: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:45.387: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:47.424: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:49.463: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:51.505: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:53.542: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:55.579: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:57.617: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:35:59.656: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:01.693: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:03.730: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:05.768: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:07.805: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:09.847: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:11.884: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:13.921: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:15.958: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:17.994: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:20.031: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:22.069: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:24.115: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:26.152: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:28.189: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:30.226: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:32.263: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:34.303: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:36.342: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:38.378: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:40.415: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:42.453: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:44.492: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:46.529: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:48.567: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:50.604: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:52.642: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:54.679: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:56.716: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:36:58.753: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:00.792: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:02.829: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:04.875: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:06.912: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:08.952: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:10.989: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:13.025: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:15.063: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:17.100: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:19.139: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:21.176: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:23.214: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:25.251: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:27.290: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:29.328: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:31.366: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:33.403: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:35.439: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:37.477: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:39.517: INFO: VolumeSnapshot snapshot-6gktm found but is not ready. Jun 18 06:37:41.554: INFO: VolumeSnapshot snapshot-6gktm found and is ready Jun 18 06:37:41.554: INFO: WaitUntil finished successfully after 3m29.941686147s Jun 18 06:37:41.590: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-a04dca9b-fa7d-4aa4-8b93-eb816c0d1b3e creationTime:2022-06-18T06:34:12Z readyToUse:true restoreSize:5Gi] Jun 18 06:37:41.590: INFO: snapshotContentName snapcontent-a04dca9b-fa7d-4aa4-8b93-eb816c0d1b3e �[1mSTEP�[0m: updating the snapshot content deletion policy to retain �[1mSTEP�[0m: recording properties of the preprovisioned snapshot Jun 18 06:37:41.666: INFO: Recording snapshot content handle: projects/kubernetes-gci-scale/global/snapshots/snapshot-a04dca9b-fa7d-4aa4-8b93-eb816c0d1b3e Jun 18 06:37:41.666: INFO: Recording snapshot content annotations: map[] Jun 18 06:37:41.666: INFO: Recording snapshot driver: pd.csi.storage.gke.io �[1mSTEP�[0m: deleting the snapshot and snapshot content �[1mSTEP�[0m: checking the Snapshot has been deleted Jun 18 06:37:41.706: INFO: Waiting up to 5m0s for volumesnapshots snapshotting-5417 to be deleted Jun 18 06:37:41.741: INFO: volumesnapshots snapshotting-5417 is not found in namespace snapshot-6gktm and has been deleted Jun 18 06:37:41.741: INFO: WaitUntil finished successfully after 35.243766ms �[1mSTEP�[0m: checking the Snapshot content has been deleted Jun 18 06:37:41.780: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-a04dca9b-fa7d-4aa4-8b93-eb816c0d1b3e to be deleted Jun 18 06:37:41.815: INFO: volumesnapshotcontents snapcontent-a04dca9b-fa7d-4aa4-8b93-eb816c0d1b3e is not found and has been deleted Jun 18 06:37:41.815: INFO: WaitUntil finished successfully after 35.485573ms �[1mSTEP�[0m: creating a snapshot content with the snapshot handle �[1mSTEP�[0m: creating a snapshot with that snapshot content Jun 18 06:37:41.896: INFO: Waiting up to 5m0s for VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e to become ready Jun 18 06:37:41.931: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:37:43.968: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:37:46.011: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:37:48.048: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:37:50.084: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:37:52.120: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:37:54.158: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:37:56.194: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:37:58.231: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:00.267: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:02.308: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:04.347: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:06.387: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:08.424: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:10.461: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:12.498: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:14.536: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:16.573: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:18.610: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:20.647: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:22.685: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:24.723: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:26.761: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:28.798: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:30.835: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:32.874: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:34.912: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:36.949: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:38.986: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:41.022: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:43.060: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:45.097: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:47.134: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:49.170: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:51.208: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:53.245: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:55.283: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:57.321: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:38:59.358: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:01.397: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:03.433: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:05.470: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:07.508: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:09.545: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:11.583: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:13.621: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:15.659: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:17.696: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:19.733: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:21.770: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:23.806: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:25.843: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:27.879: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:29.915: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:31.952: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:33.989: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:36.025: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:38.066: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:40.103: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:42.140: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:44.176: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:46.214: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:48.250: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:50.287: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:52.326: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:54.363: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:56.399: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:39:58.435: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:00.474: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:02.512: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:04.550: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:06.587: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:08.624: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:10.666: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:12.705: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:14.742: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:16.778: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:18.815: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:20.851: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:22.888: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:24.925: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:26.963: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:29.000: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:31.038: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:33.076: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:35.114: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:37.151: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:39.190: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:41.228: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:43.265: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:45.302: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:47.342: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:49.379: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:51.417: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:53.480: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:55.518: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:57.556: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:40:59.593: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:01.629: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:03.667: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:05.705: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:07.743: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:09.792: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:11.830: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:13.875: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:15.916: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:18.045: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:20.084: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:22.131: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:24.169: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:26.207: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:28.245: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:30.284: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:32.325: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:34.363: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:36.404: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:38.443: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:40.481: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:42.520: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:44.557: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:46.594: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:48.631: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:50.669: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:52.708: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:54.746: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:56.784: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:41:58.831: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:00.874: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:02.912: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:04.951: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:06.989: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:09.026: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:11.064: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:13.101: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:15.139: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:17.175: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:19.214: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:21.251: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:23.288: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:25.325: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:27.362: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:29.400: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:31.437: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:33.473: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:35.510: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:37.550: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:39.587: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:41.625: INFO: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e found but is not ready. Jun 18 06:42:43.626: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 18 06:42:43.626: INFO: Unexpected error: <*errors.errorString | 0xc00242b260>: { s: "VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e is not ready within 5m0s", } Jun 18 06:42:43.626: FAIL: VolumeSnapshot pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7fdc3827a6f8, 0xc0010ce9c0}, 0xc003c2f200, {{0x71ffffc, 0x28}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:156 +0x1a6b k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.4.2() test/e2e/storage/testsuites/snapshottable.go:359 +0xb7d k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24d6d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007ba680, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f [AfterEach] volume snapshot controller test/e2e/storage/testsuites/snapshottable.go:172 �[1mSTEP�[0m: Deleting pvc Jun 18 06:42:43.795: INFO: Deleting PersistentVolumeClaim "pd.csi.storage.gke.io974j9" Jun 18 06:42:43.896: INFO: Waiting up to 5m0s for PersistentVolume pvc-80a7fc37-dd0c-44b0-8736-46ed132f5c1d to get deleted Jun 18 06:42:44.001: INFO: PersistentVolume pvc-80a7fc37-dd0c-44b0-8736-46ed132f5c1d found and phase=Released (104.116858ms) Jun 18 06:42:49.095: INFO: PersistentVolume pvc-80a7fc37-dd0c-44b0-8736-46ed132f5c1d was removed �[1mSTEP�[0m: Deleting sc �[1mSTEP�[0m: deleting the test namespace: snapshotting-5417 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-5417". �[1mSTEP�[0m: Found 14 events. Jun 18 06:42:49.298: INFO: At 2022-06-18 06:33:42 +0000 UTC - event for pd.csi.storage.gke.io974j9: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jun 18 06:42:49.298: INFO: At 2022-06-18 06:33:42 +0000 UTC - event for pd.csi.storage.gke.io974j9: {pd.csi.storage.gke.io_bootstrap-e2e-minion-group-wxzs_badbce80-5e50-4328-98a8-b7ec0db10323 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-5417/pd.csi.storage.gke.io974j9" Jun 18 06:42:49.298: INFO: At 2022-06-18 06:33:42 +0000 UTC - event for pd.csi.storage.gke.io974j9: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jun 18 06:42:49.298: INFO: At 2022-06-18 06:33:46 +0000 UTC - event for pd.csi.storage.gke.io974j9: {pd.csi.storage.gke.io_bootstrap-e2e-minion-group-wxzs_badbce80-5e50-4328-98a8-b7ec0db10323 } ProvisioningSucceeded: Successfully provisioned volume pvc-80a7fc37-dd0c-44b0-8736-46ed132f5c1d Jun 18 06:42:49.298: INFO: At 2022-06-18 06:33:46 +0000 UTC - event for pvc-snapshottable-tester-ktfcz: {default-scheduler } Scheduled: Successfully assigned snapshotting-5417/pvc-snapshottable-tester-ktfcz to bootstrap-e2e-minion-group-d5bn Jun 18 06:42:49.298: INFO: At 2022-06-18 06:33:56 +0000 UTC - event for pvc-snapshottable-tester-ktfcz: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-80a7fc37-dd0c-44b0-8736-46ed132f5c1d" Jun 18 06:42:49.298: INFO: At 2022-06-18 06:33:57 +0000 UTC - event for pvc-snapshottable-tester-ktfcz: {kubelet bootstrap-e2e-minion-group-d5bn} Pulling: Pulling image "registry.k8s.io/e2e-test-images/busybox:1.29-2" Jun 18 06:42:49.298: INFO: At 2022-06-18 06:33:58 +0000 UTC - event for pvc-snapshottable-tester-ktfcz: {kubelet bootstrap-e2e-minion-group-d5bn} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/busybox:1.29-2" in 623.345192ms Jun 18 06:42:49.298: INFO: At 2022-06-18 06:33:58 +0000 UTC - event for pvc-snapshottable-tester-ktfcz: {kubelet bootstrap-e2e-minion-group-d5bn} Created: Created container volume-tester Jun 18 06:42:49.298: INFO: At 2022-06-18 06:33:58 +0000 UTC - event for pvc-snapshottable-tester-ktfcz: {kubelet bootstrap-e2e-minion-group-d5bn} Started: Started container volume-tester Jun 18 06:42:49.298: INFO: At 2022-06-18 06:34:11 +0000 UTC - event for snapshot-6gktm: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-5417/snapshot-6gktm to be created by the CSI driver. Jun 18 06:42:49.298: INFO: At 2022-06-18 06:37:40 +0000 UTC - event for snapshot-6gktm: {snapshot-controller } SnapshotReady: Snapshot snapshotting-5417/snapshot-6gktm is ready to use. Jun 18 06:42:49.298: INFO: At 2022-06-18 06:37:40 +0000 UTC - event for snapshot-6gktm: {snapshot-controller } SnapshotCreated: Snapshot snapshotting-5417/snapshot-6gktm was successfully created by the CSI driver. Jun 18 06:42:49.298: INFO: At 2022-06-18 06:37:41 +0000 UTC - event for pre-provisioned-snapshot-01b48548-8f74-4c5a-a275-6a2f5a3dc09e: {snapshot-controller } SnapshotBindFailed: Snapshot failed to bind VolumeSnapshotContent, volumesnapshotcontents.snapshot.storage.k8s.io "pre-provisioned-snapcontent-01b48548-8f74-4c5a-a275-6a2f5a3dc09e" is forbidden: User "system:serviceaccount:kube-system:volume-snapshot-controller" cannot patch resource "volumesnapshotcontents" in API group "snapshot.storage.k8s.io" at the cluster scope Jun 18 06:42:49.398: INFO: POD NODE PHASE GRACE CONDITIONS Jun 18 06:42:49.398: INFO: Jun 18 06:42:49.498: INFO: Logging node info for node bootstrap-e2e-master Jun 18 06:42:49.596: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 764be954-a567-4f02-916f-ce5a00efd5a2 7067 0 2022-06-18 05:52:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/kubernetes-gci-scale/zones/us-west1-b/instances/bootstrap-e2e-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:39:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:06 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:06 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:06 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:39:06 +0000 UTC,LastTransitionTime:2022-06-18 05:52:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.44.136,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:476dc4d83f3dde8536c284cad61ff0ba,SystemUUID:476dc4d8-3f3d-de85-36c2-84cad61ff0ba,BootID:aef22f04-bc7e-4174-a5b7-27a33f86acf6,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:117361475,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:42:49.597: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 18 06:42:49.697: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 18 06:42:49.814: INFO: csi-gce-pd-node-ntltk started at 2022-06-18 06:33:27 +0000 UTC (0+2 container statuses recorded) Jun 18 06:42:49.814: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 18 06:42:49.814: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 18 06:42:49.814: INFO: metadata-proxy-v0.1-7s94z started at 2022-06-18 05:52:25 +0000 UTC (0+2 container statuses recorded) Jun 18 06:42:49.814: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:42:49.814: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:42:49.814: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:49.814: INFO: Container kube-apiserver ready: true, restart count 0 Jun 18 06:42:49.814: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:49.814: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 18 06:42:49.814: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:49.814: INFO: Container kube-scheduler ready: true, restart count 0 Jun 18 06:42:49.814: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:49.814: INFO: Container etcd-container ready: true, restart count 0 Jun 18 06:42:49.814: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:49.814: INFO: Container etcd-container ready: true, restart count 0 Jun 18 06:42:49.814: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-18 05:51:33 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:49.814: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 18 06:42:49.814: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-18 05:51:34 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:49.814: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 18 06:42:49.814: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:49.814: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 18 06:42:50.176: INFO: Latency metrics for node bootstrap-e2e-master Jun 18 06:42:50.176: INFO: Logging node info for node bootstrap-e2e-minion-group-d5bn Jun 18 06:42:50.247: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-d5bn 424d4104-0817-4373-8508-c511cbd42736 7627 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-d5bn kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/kubernetes-gci-scale/zones/us-west1-b/instances/bootstrap-e2e-minion-group-d5bn"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 06:33:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:39:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 06:42:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-d5bn,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:39:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.195.245,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9894badff0283b2bf82738e3ad5d94c7,SystemUUID:9894badf-f028-3b2b-f827-38e3ad5d94c7,BootID:7a96489e-7548-4291-b5ec-4dffe1df1ef8,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:42:50.247: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-d5bn Jun 18 06:42:50.348: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-d5bn Jun 18 06:42:50.481: INFO: kube-proxy-bootstrap-e2e-minion-group-d5bn started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:50.481: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:42:50.481: INFO: metadata-proxy-v0.1-d6z5f started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 06:42:50.481: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:42:50.481: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:42:50.481: INFO: konnectivity-agent-8fmbm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:50.481: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:42:50.481: INFO: coredns-85bc9d67b-ggpbp started at 2022-06-18 05:52:38 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:50.481: INFO: Container coredns ready: true, restart count 0 Jun 18 06:42:50.481: INFO: csi-gce-pd-node-8wf6d started at 2022-06-18 06:33:27 +0000 UTC (0+2 container statuses recorded) Jun 18 06:42:50.481: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 18 06:42:50.481: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 18 06:42:50.793: INFO: Latency metrics for node bootstrap-e2e-minion-group-d5bn Jun 18 06:42:50.793: INFO: Logging node info for node bootstrap-e2e-minion-group-t6ww Jun 18 06:42:50.848: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-t6ww 5e9180b3-4ff0-4628-af58-a045ab4463b5 7628 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-t6ww kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-t6ww topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/kubernetes-gci-scale/zones/us-west1-b/instances/bootstrap-e2e-minion-group-t6ww"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 05:54:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:38:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 06:42:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-t6ww,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:57 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:57 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:57 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:38:57 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.105.119.210,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bf6eeb9eea04689287c5553b652cfd,SystemUUID:23bf6eeb-9eea-0468-9287-c5553b652cfd,BootID:a71f43cc-74ef-43c7-8805-f91aadd8f915,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:42:50.849: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-t6ww Jun 18 06:42:50.948: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-t6ww Jun 18 06:42:51.071: INFO: volume-snapshot-controller-0 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:51.071: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 18 06:42:51.071: INFO: konnectivity-agent-g7wjm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:51.071: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:42:51.071: INFO: kube-proxy-bootstrap-e2e-minion-group-t6ww started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:51.071: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:42:51.071: INFO: coredns-85bc9d67b-svgwq started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:51.071: INFO: Container coredns ready: true, restart count 0 Jun 18 06:42:51.071: INFO: kube-dns-autoscaler-5477bd659c-8dcq9 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:51.071: INFO: Container autoscaler ready: true, restart count 0 Jun 18 06:42:51.071: INFO: l7-default-backend-5f6f9745f9-x6d4r started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:51.071: INFO: Container default-http-backend ready: true, restart count 0 Jun 18 06:42:51.071: INFO: csi-gce-pd-node-jkng4 started at 2022-06-18 06:33:27 +0000 UTC (0+2 container statuses recorded) Jun 18 06:42:51.071: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 18 06:42:51.071: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 18 06:42:51.071: INFO: metadata-proxy-v0.1-w878c started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 06:42:51.071: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:42:51.071: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:42:51.396: INFO: Latency metrics for node bootstrap-e2e-minion-group-t6ww Jun 18 06:42:51.396: INFO: Logging node info for node bootstrap-e2e-minion-group-wxzs Jun 18 06:42:51.447: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-wxzs ea3ba9a8-6c89-4646-b31b-38927e0b4aa7 7644 0 2022-06-18 05:52:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-wxzs kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-wxzs topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/kubernetes-gci-scale/zones/us-west1-b/instances/bootstrap-e2e-minion-group-wxzs"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 06:18:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:38:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 06:42:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-wxzs,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:58 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:58 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:58 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:38:58 +0000 UTC,LastTransitionTime:2022-06-18 05:52:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.230.184,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6715ba26207e0d851190b6989ac9096d,SystemUUID:6715ba26-207e-0d85-1190-b6989ac9096d,BootID:5cbacacb-c39e-42cb-abc9-35d40363f85b,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:dc0301d9a43e23e389abb7690cd631f98af76ea3429259c7f5f643fd31fc0a3e registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0],SizeBytes:27914152,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:42:51.447: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-wxzs Jun 18 06:42:51.547: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-wxzs Jun 18 06:42:51.671: INFO: csi-gce-pd-controller-0 started at 2022-06-18 06:33:27 +0000 UTC (0+5 container statuses recorded) Jun 18 06:42:51.671: INFO: Container csi-attacher ready: true, restart count 0 Jun 18 06:42:51.671: INFO: Container csi-provisioner ready: true, restart count 0 Jun 18 06:42:51.671: INFO: Container csi-resizer ready: true, restart count 0 Jun 18 06:42:51.671: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 18 06:42:51.671: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 18 06:42:51.671: INFO: kube-proxy-bootstrap-e2e-minion-group-wxzs started at 2022-06-18 05:52:20 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:51.671: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:42:51.671: INFO: metadata-proxy-v0.1-prz9j started at 2022-06-18 05:52:21 +0000 UTC (0+2 container statuses recorded) Jun 18 06:42:51.671: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:42:51.671: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jun 18 06:42:51.671: INFO: konnectivity-agent-hddcn started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:42:51.671: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:42:51.671: INFO: metrics-server-v0.5.2-755d66fb57-m6k8h started at 2022-06-18 05:52:47 +0000 UTC (0+2 container statuses recorded) Jun 18 06:42:51.671: INFO: Container metrics-server ready: true, restart count 1 Jun 18 06:42:51.671: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 18 06:42:51.671: INFO: csi-gce-pd-node-q255w started at 2022-06-18 06:33:27 +0000 UTC (0+2 container statuses recorded) Jun 18 06:42:51.671: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 18 06:42:51.671: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 18 06:42:52.011: INFO: Latency metrics for node bootstrap-e2e-minion-group-wxzs �[1mSTEP�[0m: Waiting for namespaces [snapshotting-5417] to vanish �[1mSTEP�[0m: uninstalling csi gce-pd driver Jun 18 06:43:04.146: INFO: deleting *v1.ServiceAccount: snapshotting-5417-3753/csi-attacher Jun 18 06:43:04.248: INFO: deleting *v1.ClusterRole: external-attacher-runner-snapshotting-5417 Jun 18 06:43:04.348: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-5417 Jun 18 06:43:04.448: INFO: deleting *v1.Role: snapshotting-5417-3753/external-attacher-cfg-snapshotting-5417 Jun 18 06:43:04.548: INFO: deleting *v1.RoleBinding: snapshotting-5417-3753/csi-attacher-role-cfg Jun 18 06:43:04.648: INFO: deleting *v1.ServiceAccount: snapshotting-5417-3753/csi-provisioner Jun 18 06:43:04.747: INFO: deleting *v1.ClusterRole: external-provisioner-runner-snapshotting-5417 Jun 18 06:43:04.847: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-5417 Jun 18 06:43:04.947: INFO: deleting *v1.Role: snapshotting-5417-3753/external-provisioner-cfg-snapshotting-5417 Jun 18 06:43:05.047: INFO: deleting *v1.RoleBinding: snapshotting-5417-3753/csi-provisioner-role-cfg Jun 18 06:43:05.148: INFO: deleting *v1.ServiceAccount: snapshotting-5417-3753/csi-gce-pd-controller-sa Jun 18 06:43:05.247: INFO: deleting *v1.ClusterRole: csi-gce-pd-provisioner-role-snapshotting-5417 Jun 18 06:43:05.349: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-provisioner-binding-snapshotting-5417 Jun 18 06:43:05.448: INFO: deleting *v1.ClusterRole: csi-gce-pd-attacher-role-snapshotting-5417 Jun 18 06:43:05.547: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-attacher-binding-snapshotting-5417 Jun 18 06:43:05.648: INFO: deleting *v1.ClusterRole: csi-gce-pd-resizer-role-snapshotting-5417 Jun 18 06:43:05.747: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-resizer-binding-snapshotting-5417 Jun 18 06:43:05.847: INFO: deleting *v1.ClusterRole: csi-gce-pd-snapshotter-role-snapshotting-5417 Jun 18 06:43:05.947: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-snapshotter-binding-snapshotting-5417 Jun 18 06:43:06.050: INFO: deleting *v1.Role: snapshotting-5417-3753/csi-gce-pd-leaderelection-role-snapshotting-5417 Jun 18 06:43:06.148: INFO: deleting *v1.RoleBinding: snapshotting-5417-3753/csi-gce-pd-controller-leaderelection-binding Jun 18 06:43:06.246: INFO: deleting *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-snapshotting-5417 Jun 18 06:43:06.349: INFO: deleting *v1.DaemonSet: snapshotting-5417-3753/csi-gce-pd-node Jun 18 06:43:06.449: INFO: deleting *v1.StatefulSet: snapshotting-5417-3753/csi-gce-pd-controller �[1mSTEP�[0m: deleting the driver namespace: snapshotting-5417-3753 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-5417-3753". �[1mSTEP�[0m: Found 74 events. Jun 18 06:43:06.648: INFO: At 2022-06-18 06:33:27 +0000 UTC - event for csi-gce-pd-controller: {statefulset-controller } SuccessfulCreate: create Pod csi-gce-pd-controller-0 in StatefulSet csi-gce-pd-controller successful Jun 18 06:43:06.648: INFO: At 2022-06-18 06:33:27 +0000 UTC - event for csi-gce-pd-controller-0: {default-scheduler } Scheduled: Successfully assigned snapshotting-5417-3753/csi-gce-pd-controller-0 to bootstrap-e2e-minion-group-wxzs Jun 18 06:43:06.649: INFO: At 2022-06-18 06:33:27 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-ntltk Jun 18 06:43:06.649: INFO: At 2022-06-18 06:33:27 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-8wf6d Jun 18 06:43:06.649: INFO: At 2022-06-18 06:33:27 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-jkng4 Jun 18 06:43:06.650: INFO: At 2022-06-18 06:33:27 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-q255w Jun 18 06:43:06.650: INFO: At 2022-06-18 06:33:27 +0000 UTC - event for csi-gce-pd-node-8wf6d: {default-scheduler } Scheduled: Successfully assigned snapshotting-5417-3753/csi-gce-pd-node-8wf6d to bootstrap-e2e-minion-group-d5bn Jun 18 06:43:06.650: INFO: At 2022-06-18 06:33:27 +0000 UTC - event for csi-gce-pd-node-jkng4: {default-scheduler } Scheduled: Successfully assigned snapshotting-5417-3753/csi-gce-pd-node-jkng4 to bootstrap-e2e-minion-group-t6ww Jun 18 06:43:06.651: INFO: At 2022-06-18 06:33:27 +0000 UTC - event for csi-gce-pd-node-ntltk: {default-scheduler } Scheduled: Successfully assigned snapshotting-5417-3753/csi-gce-pd-node-ntltk to bootstrap-e2e-master Jun 18 06:43:06.651: INFO: At 2022-06-18 06:33:27 +0000 UTC - event for csi-gce-pd-node-q255w: {default-scheduler } Scheduled: Successfully assigned snapshotting-5417-3753/csi-gce-pd-node-q255w to bootstrap-e2e-minion-group-wxzs Jun 18 06:43:06.652: INFO: At 2022-06-18 06:33:28 +0000 UTC - event for csi-gce-pd-node-8wf6d: {kubelet bootstrap-e2e-minion-group-d5bn} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" Jun 18 06:43:06.652: INFO: At 2022-06-18 06:33:28 +0000 UTC - event for csi-gce-pd-node-ntltk: {kubelet bootstrap-e2e-master} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" Jun 18 06:43:06.652: INFO: At 2022-06-18 06:33:29 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1" Jun 18 06:43:06.653: INFO: At 2022-06-18 06:33:29 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1" in 175.815776ms Jun 18 06:43:06.653: INFO: At 2022-06-18 06:33:29 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container csi-snapshotter Jun 18 06:43:06.653: INFO: At 2022-06-18 06:33:29 +0000 UTC - event for csi-gce-pd-node-8wf6d: {kubelet bootstrap-e2e-minion-group-d5bn} Pulling: Pulling image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" Jun 18 06:43:06.654: INFO: At 2022-06-18 06:33:29 +0000 UTC - event for csi-gce-pd-node-8wf6d: {kubelet bootstrap-e2e-minion-group-d5bn} Created: Created container csi-driver-registrar Jun 18 06:43:06.654: INFO: At 2022-06-18 06:33:29 +0000 UTC - event for csi-gce-pd-node-8wf6d: {kubelet bootstrap-e2e-minion-group-d5bn} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" in 1.161612991s Jun 18 06:43:06.654: INFO: At 2022-06-18 06:33:29 +0000 UTC - event for csi-gce-pd-node-8wf6d: {kubelet bootstrap-e2e-minion-group-d5bn} Started: Started container csi-driver-registrar Jun 18 06:43:06.655: INFO: At 2022-06-18 06:33:29 +0000 UTC - event for csi-gce-pd-node-jkng4: {kubelet bootstrap-e2e-minion-group-t6ww} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" Jun 18 06:43:06.655: INFO: At 2022-06-18 06:33:29 +0000 UTC - event for csi-gce-pd-node-q255w: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" Jun 18 06:43:06.655: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container csi-snapshotter Jun 18 06:43:06.655: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Container image "registry.k8s.io/sig-storage/csi-provisioner:v3.1.0" already present on machine Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container csi-provisioner Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container csi-provisioner Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0" Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container csi-resizer Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container csi-resizer Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Container image "registry.k8s.io/sig-storage/csi-resizer:v1.4.0" already present on machine Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container csi-attacher Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Container image "registry.k8s.io/sig-storage/csi-attacher:v3.4.0" already present on machine Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container csi-attacher Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-node-jkng4: {kubelet bootstrap-e2e-minion-group-t6ww} Started: Started container csi-driver-registrar Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-node-jkng4: {kubelet bootstrap-e2e-minion-group-t6ww} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" in 1.089670967s Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-node-jkng4: {kubelet bootstrap-e2e-minion-group-t6ww} Created: Created container csi-driver-registrar Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-node-jkng4: {kubelet bootstrap-e2e-minion-group-t6ww} Pulling: Pulling image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-node-ntltk: {kubelet bootstrap-e2e-master} Pulling: Pulling image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-node-ntltk: {kubelet bootstrap-e2e-master} Created: Created container csi-driver-registrar Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-node-ntltk: {kubelet bootstrap-e2e-master} Started: Started container csi-driver-registrar Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-node-ntltk: {kubelet bootstrap-e2e-master} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" in 1.652332237s Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-node-q255w: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container csi-driver-registrar Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:30 +0000 UTC - event for csi-gce-pd-node-q255w: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" in 1.483283027s Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:31 +0000 UTC - event for csi-gce-pd-node-q255w: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container csi-driver-registrar Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:31 +0000 UTC - event for csi-gce-pd-node-q255w: {kubelet bootstrap-e2e-minion-group-wxzs} Pulling: Pulling image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:33 +0000 UTC - event for csi-gce-pd-node-8wf6d: {kubelet bootstrap-e2e-minion-group-d5bn} Pulled: Successfully pulled image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" in 4.071637179s Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:34 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Successfully pulled image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0" in 3.733318941s Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:34 +0000 UTC - event for csi-gce-pd-node-jkng4: {kubelet bootstrap-e2e-minion-group-t6ww} Pulled: Successfully pulled image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" in 4.017613659s Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:35 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:35 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:35 +0000 UTC - event for csi-gce-pd-node-8wf6d: {kubelet bootstrap-e2e-minion-group-d5bn} Created: Created container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:35 +0000 UTC - event for csi-gce-pd-node-8wf6d: {kubelet bootstrap-e2e-minion-group-d5bn} Started: Started container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:36 +0000 UTC - event for csi-gce-pd-node-jkng4: {kubelet bootstrap-e2e-minion-group-t6ww} Started: Started container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:36 +0000 UTC - event for csi-gce-pd-node-jkng4: {kubelet bootstrap-e2e-minion-group-t6ww} Created: Created container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:36 +0000 UTC - event for external-attacher-leader-pd-csi-storage-gke-io: {external-attacher-leader-pd.csi.storage.gke.io/bootstrap-e2e-minion-group-wxzs } LeaderElection: bootstrap-e2e-minion-group-wxzs became leader Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:36 +0000 UTC - event for external-resizer-pd-csi-storage-gke-io: {external-resizer-pd-csi-storage-gke-io/bootstrap-e2e-minion-group-wxzs } LeaderElection: bootstrap-e2e-minion-group-wxzs became leader Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:36 +0000 UTC - event for external-snapshotter-leader-pd-csi-storage-gke-io: {external-snapshotter-leader-pd.csi.storage.gke.io/bootstrap-e2e-minion-group-wxzs } LeaderElection: bootstrap-e2e-minion-group-wxzs became leader Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:36 +0000 UTC - event for pd-csi-storage-gke-io: {pd.csi.storage.gke.io/bootstrap-e2e-minion-group-wxzs } LeaderElection: bootstrap-e2e-minion-group-wxzs became leader Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:37 +0000 UTC - event for csi-gce-pd-node-ntltk: {kubelet bootstrap-e2e-master} Pulled: Successfully pulled image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" in 6.212232826s Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:37 +0000 UTC - event for csi-gce-pd-node-q255w: {kubelet bootstrap-e2e-minion-group-wxzs} Pulled: Successfully pulled image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" in 6.456282192s Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:38 +0000 UTC - event for csi-gce-pd-node-ntltk: {kubelet bootstrap-e2e-master} Created: Created container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:38 +0000 UTC - event for csi-gce-pd-node-ntltk: {kubelet bootstrap-e2e-master} Started: Started container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:38 +0000 UTC - event for csi-gce-pd-node-q255w: {kubelet bootstrap-e2e-minion-group-wxzs} Created: Created container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:33:38 +0000 UTC - event for csi-gce-pd-node-q255w: {kubelet bootstrap-e2e-minion-group-wxzs} Started: Started container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:43:06 +0000 UTC - event for csi-gce-pd-node-8wf6d: {kubelet bootstrap-e2e-minion-group-d5bn} FailedPreStopHook: Exec lifecycle hook ([/bin/sh -c rm -rf /registration/pd.csi.storage.gke.io /registration/pd.csi.storage.gke.io-reg.sock]) for Container "csi-driver-registrar" in Pod "csi-gce-pd-node-8wf6d_snapshotting-5417-3753(544276d1-a2cd-475d-b969-392629cc2ae3)" failed - error: rpc error: code = Unknown desc = failed to exec in container: failed to start exec "d231f92e7001e27eeaddfb2f4cd3017a6a485270e455ddd806922c7fae9d84c8": OCI runtime exec failed: exec failed: container_linux.go:380: starting container process caused: exec: "/bin/sh": stat /bin/sh: no such file or directory: unknown, message: "" Jun 18 06:43:06.656: INFO: At 2022-06-18 06:43:06 +0000 UTC - event for csi-gce-pd-node-8wf6d: {kubelet bootstrap-e2e-minion-group-d5bn} Killing: Stopping container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:43:06 +0000 UTC - event for csi-gce-pd-node-8wf6d: {kubelet bootstrap-e2e-minion-group-d5bn} Killing: Stopping container csi-driver-registrar Jun 18 06:43:06.656: INFO: At 2022-06-18 06:43:06 +0000 UTC - event for csi-gce-pd-node-jkng4: {kubelet bootstrap-e2e-minion-group-t6ww} FailedPreStopHook: Exec lifecycle hook ([/bin/sh -c rm -rf /registration/pd.csi.storage.gke.io /registration/pd.csi.storage.gke.io-reg.sock]) for Container "csi-driver-registrar" in Pod "csi-gce-pd-node-jkng4_snapshotting-5417-3753(7b3ad839-7d41-460d-a2a0-b68d90e4ea46)" failed - error: rpc error: code = Unknown desc = failed to exec in container: failed to start exec "15d403d22858accb6401cd924af69d47731399d75aeabf19344e10082a29c84d": OCI runtime exec failed: exec failed: container_linux.go:380: starting container process caused: exec: "/bin/sh": stat /bin/sh: no such file or directory: unknown, message: "" Jun 18 06:43:06.656: INFO: At 2022-06-18 06:43:06 +0000 UTC - event for csi-gce-pd-node-jkng4: {kubelet bootstrap-e2e-minion-group-t6ww} Killing: Stopping container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:43:06 +0000 UTC - event for csi-gce-pd-node-jkng4: {kubelet bootstrap-e2e-minion-group-t6ww} Killing: Stopping container csi-driver-registrar Jun 18 06:43:06.656: INFO: At 2022-06-18 06:43:06 +0000 UTC - event for csi-gce-pd-node-ntltk: {kubelet bootstrap-e2e-master} Killing: Stopping container gce-pd-driver Jun 18 06:43:06.656: INFO: At 2022-06-18 06:43:06 +0000 UTC - event for csi-gce-pd-node-ntltk: {kubelet bootstrap-e2e-master} Killing: Stopping container csi-driver-registrar Jun 18 06:43:06.656: INFO: At 2022-06-18 06:43:06 +0000 UTC - event for csi-gce-pd-node-q255w: {kubelet bootstrap-e2e-minion-group-wxzs} Killing: Stopping container csi-driver-registrar Jun 18 06:43:06.656: INFO: At 2022-06-18 06:43:06 +0000 UTC - event for csi-gce-pd-node-q255w: {kubelet bootstrap-e2e-minion-group-wxzs} FailedPreStopHook: Exec lifecycle hook ([/bin/sh -c rm -rf /registration/pd.csi.storage.gke.io /registration/pd.csi.storage.gke.io-reg.sock]) for Container "csi-driver-registrar" in Pod "csi-gce-pd-node-q255w_snapshotting-5417-3753(0a191605-6334-4975-9f74-69d87237f629)" failed - error: rpc error: code = Unknown desc = failed to exec in container: failed to start exec "2cedf6932905b40641cf18f4e1fce713568fdd6539ed3b10f5acfb584f7c6b5b": OCI runtime exec failed: exec failed: container_linux.go:380: starting container process caused: exec: "/bin/sh": stat /bin/sh: no such file or directory: unknown, message: "" Jun 18 06:43:06.656: INFO: At 2022-06-18 06:43:06 +0000 UTC - event for csi-gce-pd-node-q255w: {kubelet bootstrap-e2e-minion-group-wxzs} Killing: Stopping container gce-pd-driver Jun 18 06:43:06.701: INFO: POD NODE PHASE GRACE CONDITIONS Jun 18 06:43:06.701: INFO: csi-gce-pd-controller-0 bootstrap-e2e-minion-group-wxzs Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:27 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:36 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:36 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:27 +0000 UTC }] Jun 18 06:43:06.701: INFO: csi-gce-pd-node-8wf6d bootstrap-e2e-minion-group-d5bn Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:27 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:36 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:36 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:27 +0000 UTC }] Jun 18 06:43:06.701: INFO: csi-gce-pd-node-jkng4 bootstrap-e2e-minion-group-t6ww Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:27 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:37 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:37 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:27 +0000 UTC }] Jun 18 06:43:06.701: INFO: csi-gce-pd-node-ntltk bootstrap-e2e-master Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:27 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:39 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:39 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:27 +0000 UTC }] Jun 18 06:43:06.701: INFO: csi-gce-pd-node-q255w bootstrap-e2e-minion-group-wxzs Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:27 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:38 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:38 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-18 06:33:27 +0000 UTC }] Jun 18 06:43:06.701: INFO: Jun 18 06:43:07.461: INFO: Logging node info for node bootstrap-e2e-master Jun 18 06:43:07.536: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 764be954-a567-4f02-916f-ce5a00efd5a2 7791 0 2022-06-18 05:52:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:39:06 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:06 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:06 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:06 +0000 UTC,LastTransitionTime:2022-06-18 05:52:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:39:06 +0000 UTC,LastTransitionTime:2022-06-18 05:52:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.44.136,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:476dc4d83f3dde8536c284cad61ff0ba,SystemUUID:476dc4d8-3f3d-de85-36c2-84cad61ff0ba,BootID:aef22f04-bc7e-4174-a5b7-27a33f86acf6,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:117361475,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:43:07.536: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 18 06:43:07.643: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 18 06:43:07.724: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:07.724: INFO: Container etcd-container ready: true, restart count 0 Jun 18 06:43:07.724: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-18 05:51:33 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:07.724: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 18 06:43:07.724: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-18 05:51:34 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:07.724: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 18 06:43:07.724: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:07.724: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 18 06:43:07.724: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:07.724: INFO: Container kube-apiserver ready: true, restart count 0 Jun 18 06:43:07.724: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:07.724: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 18 06:43:07.724: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:07.724: INFO: Container kube-scheduler ready: true, restart count 0 Jun 18 06:43:07.724: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-18 05:50:58 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:07.724: INFO: Container etcd-container ready: true, restart count 0 Jun 18 06:43:07.724: INFO: metadata-proxy-v0.1-7s94z started at 2022-06-18 05:52:25 +0000 UTC (0+2 container statuses recorded) Jun 18 06:43:07.724: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:43:07.724: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:43:07.724: INFO: csi-gce-pd-node-ntltk started at 2022-06-18 06:33:27 +0000 UTC (0+2 container statuses recorded) Jun 18 06:43:07.724: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 18 06:43:07.724: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 18 06:43:08.036: INFO: Latency metrics for node bootstrap-e2e-master Jun 18 06:43:08.036: INFO: Logging node info for node bootstrap-e2e-minion-group-d5bn Jun 18 06:43:08.078: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-d5bn 424d4104-0817-4373-8508-c511cbd42736 7798 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-d5bn kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 06:33:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:39:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 06:42:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-d5bn,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:22 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:39:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:39:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.195.245,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-d5bn.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9894badff0283b2bf82738e3ad5d94c7,SystemUUID:9894badf-f028-3b2b-f827-38e3ad5d94c7,BootID:7a96489e-7548-4291-b5ec-4dffe1df1ef8,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:43:08.079: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-d5bn Jun 18 06:43:08.118: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-d5bn Jun 18 06:43:08.167: INFO: kube-proxy-bootstrap-e2e-minion-group-d5bn started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:08.167: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:43:08.167: INFO: metadata-proxy-v0.1-d6z5f started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 06:43:08.167: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:43:08.167: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:43:08.167: INFO: konnectivity-agent-8fmbm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:08.167: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:43:08.167: INFO: coredns-85bc9d67b-ggpbp started at 2022-06-18 05:52:38 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:08.167: INFO: Container coredns ready: true, restart count 0 Jun 18 06:43:08.329: INFO: Latency metrics for node bootstrap-e2e-minion-group-d5bn Jun 18 06:43:08.330: INFO: Logging node info for node bootstrap-e2e-minion-group-t6ww Jun 18 06:43:08.367: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-t6ww 5e9180b3-4ff0-4628-af58-a045ab4463b5 7789 0 2022-06-18 05:52:18 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-t6ww kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-t6ww topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 05:54:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:38:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 06:42:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-t6ww,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:26 +0000 UTC,LastTransitionTime:2022-06-18 05:52:21 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:57 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:57 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:57 +0000 UTC,LastTransitionTime:2022-06-18 05:52:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:38:57 +0000 UTC,LastTransitionTime:2022-06-18 05:52:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.105.119.210,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-t6ww.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bf6eeb9eea04689287c5553b652cfd,SystemUUID:23bf6eeb-9eea-0468-9287-c5553b652cfd,BootID:a71f43cc-74ef-43c7-8805-f91aadd8f915,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:43:08.367: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-t6ww Jun 18 06:43:08.405: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-t6ww Jun 18 06:43:08.453: INFO: metadata-proxy-v0.1-w878c started at 2022-06-18 05:52:19 +0000 UTC (0+2 container statuses recorded) Jun 18 06:43:08.453: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:43:08.453: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 18 06:43:08.453: INFO: coredns-85bc9d67b-svgwq started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:08.453: INFO: Container coredns ready: true, restart count 0 Jun 18 06:43:08.453: INFO: kube-dns-autoscaler-5477bd659c-8dcq9 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:08.453: INFO: Container autoscaler ready: true, restart count 0 Jun 18 06:43:08.453: INFO: l7-default-backend-5f6f9745f9-x6d4r started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:08.453: INFO: Container default-http-backend ready: true, restart count 0 Jun 18 06:43:08.453: INFO: kube-proxy-bootstrap-e2e-minion-group-t6ww started at 2022-06-18 05:52:18 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:08.453: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:43:08.453: INFO: volume-snapshot-controller-0 started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:08.453: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 18 06:43:08.453: INFO: konnectivity-agent-g7wjm started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:08.453: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:43:08.621: INFO: Latency metrics for node bootstrap-e2e-minion-group-t6ww Jun 18 06:43:08.621: INFO: Logging node info for node bootstrap-e2e-minion-group-wxzs Jun 18 06:43:08.658: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-wxzs ea3ba9a8-6c89-4646-b31b-38927e0b4aa7 7793 0 2022-06-18 05:52:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-wxzs kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-wxzs topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-18 05:52:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-18 05:52:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-18 06:18:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-18 06:38:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-18 06:42:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://kubernetes-gci-scale/us-west1-b/bootstrap-e2e-minion-group-wxzs,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-18 06:42:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:23 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-18 05:52:31 +0000 UTC,LastTransitionTime:2022-06-18 05:52:31 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:58 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:58 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-18 06:38:58 +0000 UTC,LastTransitionTime:2022-06-18 05:52:20 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-18 06:38:58 +0000 UTC,LastTransitionTime:2022-06-18 05:52:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.230.184,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-wxzs.c.kubernetes-gci-scale.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6715ba26207e0d851190b6989ac9096d,SystemUUID:6715ba26-207e-0d85-1190-b6989ac9096d,BootID:5cbacacb-c39e-42cb-abc9-35d40363f85b,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,KubeProxyVersion:v1.25.0-alpha.1.38+dbb6c77de41d94,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.38_dbb6c77de41d94],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:dc0301d9a43e23e389abb7690cd631f98af76ea3429259c7f5f643fd31fc0a3e registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0],SizeBytes:27914152,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 18 06:43:08.659: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-wxzs Jun 18 06:43:08.697: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-wxzs Jun 18 06:43:08.778: INFO: kube-proxy-bootstrap-e2e-minion-group-wxzs started at 2022-06-18 05:52:20 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:08.778: INFO: Container kube-proxy ready: true, restart count 0 Jun 18 06:43:08.778: INFO: metadata-proxy-v0.1-prz9j started at 2022-06-18 05:52:21 +0000 UTC (0+2 container statuses recorded) Jun 18 06:43:08.778: INFO: Container metadata-proxy ready: true, restart count 0 Jun 18 06:43:08.778: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jun 18 06:43:08.778: INFO: konnectivity-agent-hddcn started at 2022-06-18 05:52:32 +0000 UTC (0+1 container statuses recorded) Jun 18 06:43:08.778: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 18 06:43:08.778: INFO: metrics-server-v0.5.2-755d66fb57-m6k8h started at 2022-06-18 05:52:47 +0000 UTC (0+2 container statuses recorded) Jun 18 06:43:08.778: INFO: Container metrics-server ready: true, restart count 1 Jun 18 06:43:08.778: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 18 06:43:08.963: INFO: Latency metrics for node bootstrap-e2e-minion-group-wxzs �[1mSTEP�[0m: Waiting for namespaces [snapshotting-5417-3753] to vanish [AfterEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:187 Jun 18 06:43:15.038: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\smock\svolume\sCSI\sSnapshot\sController\smetrics\s\[Feature\:VolumeSnapshotDataSource\]\ssnapshot\scontroller\sshould\semit\spre\-provisioned\sCreateSnapshot\,\sCreateSnapshotAndReady\,\sand\sDeleteSnapshot\smetrics$'
test/e2e/storage/csi_mock_volume.go:1891 Jun 18 07:37:26.361: VolumeSnapshot snapshot-jx6qt is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [sig-storage] CSI mock volume test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 18 07:32:10.196: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename csi-mock-volumes �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] snapshot controller should emit pre-provisioned CreateSnapshot, CreateSnapshotAndReady, and DeleteSnapshot metrics test/e2e/storage/csi_mock_volume.go:1891 �[1mSTEP�[0m: Building a driver namespace object, basename csi-mock-volumes-312 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi mock driver Jun 18 07:32:10.802: INFO: creating *v1.ServiceAccount: csi-mock-volumes-312-8960/csi-attacher Jun 18 07:32:10.841: INFO: creating *v1.ClusterRole: external-attacher-runner-csi-mock-volumes-312 Jun 18 07:32:10.841: INFO: Define cluster role external-attacher-runner-csi-mock-volumes-312 Jun 18 07:32:10.878: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-csi-mock-volumes-312 Jun 18 07:32:10.914: INFO: creating *v1.Role: csi-mock-volumes-312-8960/external-attacher-cfg-csi-mock-volumes-312 Jun 18 07:32:10.952: INFO: creating *v1.RoleBinding: csi-mock-volumes-312-8960/csi-attacher-role-cfg Jun 18 07:32:10.990: INFO: creating *v1.ServiceAccount: csi-mock-volumes-312-8960/csi-provisioner Jun 18 07:32:11.027: INFO: creating *v1.ClusterRole: external-provisioner-runner-csi-mock-volumes-312 Jun 18 07:32:11.027: INFO: Define cluster role external-provisioner-runner-csi-mock-volumes-312 Jun 18 07:32:11.067: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-csi-mock-volumes-312 Jun 18 07:32:11.108: INFO: creating *v1.Role: csi-mock-volumes-312-8960/external-provisioner-cfg-csi-mock-volumes-312 Jun 18 07:32:11.144: INFO: creating *v1.RoleBinding: csi-mock-volumes-312-8960/csi-provisioner-role-cfg Jun 18 07:32:11.181: INFO: creating *v1.ServiceAccount: csi-mock-volumes-312-8960/csi-resizer Jun 18 07:32:11.217: INFO: creating *v1.ClusterRole: external-resizer-runner-csi-mock-volumes-312 Jun 18 07:32:11.217: INFO: Define cluster role external-resizer-runner-csi-mock-volumes-312 Jun 18 07:32:11.255: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-csi-mock-volumes-312 Jun 18 07:32:11.291: INFO: creating *v1.Role: csi-mock-volumes-312-8960/external-resizer-cfg-csi-mock-volumes-312 Jun 18 07:32:11.330: INFO: creating *v1.RoleBinding: csi-mock-volumes-312-8960/csi-resizer-role-cfg Jun 18 07:32:11.368: INFO: creating *v1.ServiceAccount: csi-mock-volumes-312-8960/csi-snapshotter Jun 18 07:32:11.410: INFO: creating *v1.ClusterRole: external-snapshotter-runner-csi-mock-volumes-312 Jun 18 07:32:11.410: INFO: Define cluster role external-snapshotter-runner-csi-mock-volumes-312 Jun 18 07:32:11.447: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-csi-mock-volumes-312 Jun 18 07:32:11.482: INFO: creating *v1.Role: csi-mock-volumes-312-8960/external-snapshotter-leaderelection-csi-mock-volumes-312 Jun 18 07:32:11.522: INFO: creating *v1.RoleBinding: csi-mock-volumes-312-8960/external-snapshotter-leaderelection Jun 18 07:32:11.562: INFO: creating *v1.ServiceAccount: csi-mock-volumes-312-8960/csi-mock Jun 18 07:32:11.599: INFO: creating *v1.ClusterRoleBinding: csi-controller-attacher-role-csi-mock-volumes-312 Jun 18 07:32:11.635: INFO: creating *v1.ClusterRoleBinding: csi-controller-provisioner-role-csi-mock-volumes-312 Jun 18 07:32:11.674: INFO: creating *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-csi-mock-volumes-312 Jun 18 07:32:11.713: INFO: creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-csi-mock-volumes-312 Jun 18 07:32:11.750: INFO: creating *v1.ClusterRoleBinding: csi-controller-resizer-role-csi-mock-volumes-312 Jun 18 07:32:11.787: INFO: creating *v1.ClusterRoleBinding: csi-controller-snapshotter-role-csi-mock-volumes-312 Jun 18 07:32:11.825: INFO: creating *v1.StorageClass: csi-mock-sc-csi-mock-volumes-312 Jun 18 07:32:11.862: INFO: creating *v1.StatefulSet: csi-mock-volumes-312-8960/csi-mockplugin Jun 18 07:32:11.903: INFO: creating *v1.CSIDriver: csi-mock-csi-mock-volumes-312 Jun 18 07:32:11.964: INFO: creating *v1.StatefulSet: csi-mock-volumes-312-8960/csi-mockplugin-snapshotter Jun 18 07:32:12.007: INFO: waiting up to 4m0s for CSIDriver "csi-mock-csi-mock-volumes-312" Jun 18 07:32:12.050: INFO: waiting for CSIDriver csi-mock-csi-mock-volumes-312 to register on node bootstrap-e2e-minion-group-wxzs Jun 18 07:32:21.841: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready" Jun 18 07:32:21.876: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=true. Elapsed: 35.216549ms Jun 18 07:32:21.876: INFO: The phase of Pod volume-snapshot-controller-0 is Running (Ready = true) Jun 18 07:32:21.876: INFO: Pod "volume-snapshot-controller-0" satisfied condition "running and ready" �[1mSTEP�[0m: getting all initial metric values �[1mSTEP�[0m: Creating storage class �[1mSTEP�[0m: Creating PVC csi-mock-volumes-312/snapshot-test-pvc �[1mSTEP�[0m: Wait for PVC to be Bound Jun 18 07:32:22.167: INFO: Waiting up to timeout=1m0s for PersistentVolumeClaims [snapshot-test-pvc] to have phase Bound Jun 18 07:32:22.211: INFO: PersistentVolumeClaim snapshot-test-pvc found but phase is Pending instead of Bound. Jun 18 07:32:24.256: INFO: PersistentVolumeClaim snapshot-test-pvc found and phase=Bound (2.088157023s) �[1mSTEP�[0m: Creating snapshot �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 18 07:32:24.458: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-jx6qt to become ready Jun 18 07:32:24.515: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:26.552: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:28.589: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:30.630: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:32.668: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:34.707: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:36.744: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:38.782: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:40.823: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:42.863: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:44.903: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:46.940: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:48.977: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:51.014: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:53.051: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:55.089: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:57.126: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:32:59.164: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:01.202: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:03.238: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:05.334: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:07.378: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:09.419: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:11.456: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:13.495: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:15.533: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:17.575: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:19.613: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:21.651: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:23.691: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:25.729: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:27.767: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:29.811: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:31.848: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:33.887: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:35.927: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:37.967: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:40.007: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:42.047: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:44.087: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:46.127: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:48.165: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:50.203: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:52.243: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:54.281: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:56.323: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:33:58.361: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:00.403: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:02.443: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:04.487: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:06.523: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:08.620: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:10.657: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:12.695: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:14.732: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:16.769: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:18.805: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:20.843: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:22.914: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:24.951: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:26.988: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:29.026: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:31.063: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:33.101: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:35.138: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:37.175: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:39.214: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:41.251: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:43.288: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:45.326: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:47.364: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:49.402: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:51.440: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:53.478: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:55.515: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:57.553: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:34:59.589: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:01.626: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:03.667: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:05.706: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:07.743: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:09.783: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:11.823: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:13.863: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:15.900: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:17.939: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:19.982: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:22.019: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:24.059: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:26.099: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:28.136: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:30.178: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:32.215: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:34.255: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:36.331: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:38.371: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:40.415: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:42.453: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:44.495: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:46.535: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:48.576: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:50.615: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:52.653: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:54.693: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:56.734: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:35:58.775: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:00.812: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:02.851: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:04.888: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:06.926: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:08.967: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:11.003: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:13.041: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:15.078: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:17.115: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:19.152: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:21.189: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:23.228: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:25.264: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:27.300: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:29.339: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:31.376: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:33.412: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:35.451: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:37.490: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:39.530: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:41.568: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:43.607: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:45.645: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:47.685: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:49.722: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:51.759: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:53.795: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:55.832: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:57.872: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:36:59.910: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:01.947: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:03.985: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:06.022: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:08.058: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:10.095: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:12.133: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:14.170: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:16.207: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:18.245: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:20.285: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:22.323: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:24.360: INFO: VolumeSnapshot snapshot-jx6qt found but is not ready. Jun 18 07:37:26.361: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 18 07:37:26.361: INFO: Unexpected error: <*errors.errorString | 0xc002db9490>: { s: "VolumeSnapshot snapshot-jx6qt is not ready within 5m0s", } Jun 18 07:37:26.361: FAIL: VolumeSnapshot snapshot-jx6qt is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc00344e650?}, 0xc003196c50) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7fdc398b9528, 0xc00404c000}, 0xc00498d5c0, {{0x71fffd4, 0x28}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage.glob..func1.21.1() test/e2e/storage/csi_mock_volume.go:1956 +0xb34 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24d6d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007ba680, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: updating the snapshot content deletion policy to retain �[1mSTEP�[0m: Deleting storageclass csi-mock-volumes-312mc2vp �[1mSTEP�[0m: Cleaning up resources �[1mSTEP�[0m: deleting the test namespace: csi-mock-volumes-312 �[1mSTEP�[0m: Waiting for namespaces [csi-mock-volumes-312] to vanish �[1mSTEP�[0m: uninstalling csi mock driver Jun 18 07:37:42.476: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-312-8960/csi-attacher Jun 18 07:37:42.514: INFO: deleting *v1.ClusterRole: external-attacher-runner-csi-mock-volumes-312 Jun 18 07:37:42.552: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-csi-mock-volumes-312 Jun 18 07:37:42.590: INFO: deleting *v1.Role: csi-mock-volumes-312-8960/external-attacher-cfg-csi-mock-volumes-312 Jun 18 07:37:42.627: INFO: deleting *v1.RoleBinding: csi-mock-volumes-312-8960/csi-attacher-role-cfg Jun 18 07:37:42.664: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-312-8960/csi-provisioner Jun 18 07:37:42.705: INFO: deleting *v1.ClusterRole: external-provisioner-runner-csi-mock-volumes-312 Jun 18 07:37:42.742: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-csi-mock-volumes-312 Jun 18 07:37:42.778: INFO: deleting *v1.Role: csi-mock-volumes-312-8960/external-provisioner-cfg-csi-mock-volumes-312 Jun 18 07:37:42.815: INFO: deleting *v1.RoleBinding: csi-mock-volumes-312-8960/csi-provisioner-role-cfg Jun 18 07:37:42.852: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-312-8960/csi-resizer Jun 18 07:37:42.891: INFO: deleting *v1.ClusterRole: external-resizer-runner-csi-mock-volumes-312 Jun 18 07:37:42.928: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-csi-mock-volumes-312 Jun 18 07:37:42.965: INFO: deleting *v1.Role: csi-mock-volumes-312-8960/external-resizer-cfg-csi-mock-volumes-312 Jun 18 07:37:43.004: INFO: deleting *v1.RoleBinding: csi-mock-volumes-312-8960/csi-resizer-role-cfg Jun 18 07:37:43.042: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-312-8960/csi-snapshotter Jun 18 07:37:43.079: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-csi-mock-volumes-312 Jun 18 07:37:43.118: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-csi-mock-volumes-312 Jun 18 07:37:43.156: INFO: deleting *v1.Role: csi-mock-volumes-312-8960/external-snapshotter-leaderelection-csi-mock-volumes-312 Jun 18 07:37:43.193: INFO: deleting *v1.RoleBinding: csi-mock-volumes-312-8960/external-snapshotter-leaderelection Jun 18 07:37:43.230: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-312-8960/csi-mock Jun 18 07:37:43.266: INFO: deleting *v1.ClusterRoleBinding: csi-controller-attacher-role-csi-mock-volumes-312 Jun 18 07:37:43.303: INFO: deleting *v1.ClusterRoleBinding: csi-controller-provisioner-role-csi-mock-volumes-312 Jun 18 07:37:43.339: INFO: deleting *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-csi-mock-volumes-312 Jun 18 07:37:43.376: INFO: deleting *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-csi-mock-volumes-312 Jun 18 07:37:43.412: INFO: deleting *v1.ClusterRoleBinding: csi-controller-resizer-role-csi-mock-volumes-312 Jun 18 07:37:43.450: INFO: deleting *v1.ClusterRoleBinding: csi-controller-snapshotter-role-csi-mock-volumes-312 Jun 18 07:37:43.487: INFO: deleting *v1.StorageClass: csi-mock-sc-csi-mock-volumes-312 Jun 18 07:37:43.523: INFO: deleting *v1.StatefulSet: csi-mock-volumes-312-8960/csi-mockplugin Jun 18 07:37:43.561: INFO: deleting *v1.CSIDriver: csi-mock-csi-mock-volumes-312 Jun 18 07:37:43.603: INFO: deleting *v1.StatefulSet: csi-mock-volumes-312-8960/csi-mockplugin-snapshotter �[1mSTEP�[0m: deleting the driver namespace: csi-mock-volumes-312-8960 �[1mSTEP�[0m: Waiting for namespaces [csi-mock-volumes-312-8960] to vanish [AfterEach] [sig-storage] CSI mock volume test/e2e/framework/framework.go:187 Jun 18 07:37:49.748: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:VolumeSnapshotDataSource\] --ginkgo.skip=\[Disruptive\]|\[Flaky\] --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true (interrupted): exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest --timeout triggered
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest Check APIReachability
kubetest Deferred TearDown
kubetest DumpClusterLogs
kubetest Extract
kubetest GetDeployer
kubetest IsUp
kubetest Prepare
kubetest TearDown
kubetest TearDown Previous
kubetest Up
kubetest diffResources
kubetest kubectl version
kubetest list nodes
kubetest listResources After
kubetest listResources Before
kubetest listResources Down
kubetest listResources Up
kubetest test setup
Kubernetes e2e suite [sig-api-machinery] API priority and fairness should ensure that requests can't be drowned out (priority)
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing mutating webhooks should work [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should honor timeout [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate configmap [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with different stored version [Conformance]
Kubernetes e2e suite [sig-api-machinery] Aggregator Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert a non homogeneous list of CRs [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition getting/updating/patching custom resource definition status sub-resource works [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition listing custom resource definition objects works [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] custom resource defaulting for requests and from storage works [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] should include custom resource definition resources in discovery documents [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] removes definition from spec when one version gets changed to not be served [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] updates the published spec when one version gets renamed [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of different groups [Conformance]
Kubernetes e2e suite [sig-api-machinery] Discovery should accurately determine present and missing resources
Kubernetes e2e suite [sig-api-machinery] Discovery should validate PreferredVersion for each APIGroup [Conformance]
Kubernetes e2e suite [sig-api-machinery] Etcd failure [Disruptive] should recover from network partition with master
Kubernetes e2e suite [sig-api-machinery] Garbage collector should delete RS created by deployment when not orphaning [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should not be blocked by dependency circle [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should orphan RS created by deployment when deleteOptions.PropagationPolicy is Orphan [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should orphan pods created by rc if delete options say so [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should support cascading deletion of custom resources
Kubernetes e2e suite [sig-api-machinery] Garbage collector should support orphan deletion of custom resources
Kubernetes e2e suite [sig-api-machinery] Namespaces [Serial] should ensure that all services are removed when a namespace is deleted [Conformance]
Kubernetes e2e suite [sig-api-machinery] Namespaces [Serial] should patch a Namespace [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against a pod with same priority class.
Kubernetes e2e suite [sig-api-machinery] ResourceQuota [Feature:ScopeSelectors] should verify ResourceQuota with terminating scopes through scope selectors.
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should be able to update and delete ResourceQuota. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a pod. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replica set. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a secret. [Conformance]
Kubernetes e2e suite [sig-api-machinery] Server request timeout default timeout should be used if the specified timeout in the request URL is 0s
Kubernetes e2e suite [sig-api-machinery] Server request timeout should return HTTP status code 400 if the user specifies an invalid timeout in the request URL
Kubernetes e2e suite [sig-api-machinery] Server request timeout the request should be served with a default timeout if the specified timeout in the request URL exceeds maximum allowed
Kubernetes e2e suite [sig-api-machinery] ServerSideApply should create an applied object if it does not already exist
Kubernetes e2e suite [sig-api-machinery] ServerSideApply should work for subresources
Kubernetes e2e suite [sig-api-machinery] Servers with support for Table transformation should return a 406 for a backend which does not implement metadata [Conformance]
Kubernetes e2e suite [sig-api-machinery] Watchers should be able to restart watching from the last resource version observed by the previous watch [Conformance]
Kubernetes e2e suite [sig-api-machinery] Watchers should be able to start watching from a specific resource version [Conformance]
Kubernetes e2e suite [sig-api-machinery] Watchers should receive events on concurrent watches in same order [Conformance]
Kubernetes e2e suite [sig-apps] CronJob should delete failed finished jobs with limit of one job
Kubernetes e2e suite [sig-apps] CronJob should delete successful finished jobs with limit of one successful job
Kubernetes e2e suite [sig-apps] CronJob should not schedule jobs when suspended [Slow] [Conformance]
Kubernetes e2e suite [sig-apps] CronJob should not schedule new jobs when ForbidConcurrent [Slow] [Conformance]
Kubernetes e2e suite [sig-apps] CronJob should replace jobs when ReplaceConcurrent [Conformance]
Kubernetes e2e suite [sig-apps] CronJob should schedule multiple jobs concurrently [Conformance]
Kubernetes e2e suite [sig-apps] Daemon set [Serial] should run and stop simple daemon [Conformance]
Kubernetes e2e suite [sig-apps] Daemon set [Serial] should update pod when spec was updated and update strategy is RollingUpdate [Conformance]
Kubernetes e2e suite [sig-apps] DaemonRestart [Disruptive] Kube-proxy should recover after being killed accidentally
Kubernetes e2e suite [sig-apps] Deployment Deployment should have a working scale subresource [Conformance]
Kubernetes e2e suite [sig-apps] Deployment RecreateDeployment should delete old pods and create new ones [Conformance]
Kubernetes e2e suite [sig-apps] Deployment deployment reaping should cascade to its replica sets and pods
Kubernetes e2e suite [sig-apps] Deployment deployment should support rollover [Conformance]
Kubernetes e2e suite [sig-apps] Deployment should run the lifecycle of a Deployment [Conformance]
Kubernetes e2e suite [sig-apps] DisruptionController should create a PodDisruptionBudget [Conformance]
Kubernetes e2e suite [sig-apps] Job should adopt matching orphans and release non-matching pods [Conformance]
Kubernetes e2e suite [sig-apps] Job should delete pods when suspended
Kubernetes e2e suite [sig-apps] Job should fail to exceed backoffLimit
Kubernetes e2e suite [sig-apps] Job should manage the lifecycle of a job [Conformance]
Kubernetes e2e suite [sig-apps] Job should run a job to completion when tasks sometimes fail and are not locally restarted
Kubernetes e2e suite [sig-apps] ReplicaSet should list and delete a collection of ReplicaSets [Conformance]
Kubernetes e2e suite [sig-apps] ReplicaSet should serve a basic image on each replica with a private image
Kubernetes e2e suite [sig-apps] ReplicaSet should serve a basic image on each replica with a public image [Conformance]
Kubernetes e2e suite [sig-apps] ReplicationController should serve a basic image on each replica with a public image [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet AvailableReplicas should get updated accordingly when MinReadySeconds is enabled
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Burst scaling should run to completion even with unhealthy pods [Slow] [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Scaling should happen in predictable order and halt if any stateful pod is unhealthy [Slow] [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should list, patch and delete a collection of StatefulSets [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications with PVCs
Kubernetes e2e suite [sig-apps] StatefulSet Deploy clustered applications [Feature:StatefulSet] [Slow] should creating a working redis cluster
Kubernetes e2e suite [sig-apps] StatefulSet MinReadySeconds should be honored when enabled
Kubernetes e2e suite [sig-apps] StatefulSet Non-retain StatefulSetPersistentVolumeClaimPolicy [Feature:StatefulSetAutoDeletePVC] should delete PVCs with a WhenDeleted policy
Kubernetes e2e suite [sig-apps] TTLAfterFinished job should be deleted once it finishes after TTL seconds
Kubernetes e2e suite [sig-auth] ServiceAccounts ServiceAccountIssuerDiscovery should support OIDC discovery of service account issuer [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts should guarantee kube-root-ca.crt exist in any namespace [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts should mount an API token into pods [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts should mount projected service account token [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts should run through the lifecycle of a ServiceAccount [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts should set ownership and permission when RunAsUser or FsGroup is present [LinuxOnly] [NodeFeature:FSGroup]
Kubernetes e2e suite [sig-auth] [Feature:NodeAuthenticator] The kubelet's main port 10250 should reject requests with no credentials
Kubernetes e2e suite [sig-auth] [Feature:NodeAuthorizer] Getting an existing secret should exit with the Forbidden error
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaler scalability [Slow] should scale up twice [Feature:ClusterAutoscalerScalability2]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] Should be able to scale a node group down to 0[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] Should not scale GPU pool up if pod does not require GPUs [GpuType:] [Feature:ClusterSizeAutoscalingGpu]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] Should scale up GPU pool from 0 [GpuType:] [Feature:ClusterSizeAutoscalingGpu]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] Shouldn't perform scale up operation and should list unhealthy status if most of the cluster is broken[Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] should be able to scale down by draining multiple pods one by one as dictated by pdb[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] should correctly scale down after a node is not needed and one node is broken [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pod requesting EmptyDir volume is pending [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] should scale down when expendable pod is running [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't increase cluster size if pending pod is too large [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't scale down when non expendable pod is running [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't scale up when expendable pod is created [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't scale up when expendable pod is preempted [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicationController Should scale from 1 pod to 3 pods and from 3 to 5 and verify decision stability
Kubernetes e2e suite [sig-autoscaling] [HPA] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) should scale down with Custom Metric of type Pod from Stackdriver [Feature:CustomMetricsAutoscaling]
Kubernetes e2e suite [sig-autoscaling] [HPA] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) should scale down with External Metric with target average value from Stackdriver [Feature:CustomMetricsAutoscaling]
Kubernetes e2e suite [sig-autoscaling] [HPA] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) should scale down with External Metric with target value from Stackdriver [Feature:CustomMetricsAutoscaling]
Kubernetes e2e suite [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects NO client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl apply should apply a new configuration to an existing RC
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl apply should reuse port when apply to an existing SVC
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl describe should check if kubectl describe prints relevant information for rc and pods [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl get componentstatuses should get componentstatuses
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl label should update the label on a resource [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl replace should update a single-container pod's image [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl server-side dry-run should check if kubectl can dry-run update Pods [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl validation should create/apply a CR with unknown fields for CRD with no validation schema
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl validation should create/apply a valid CR for CRD with validation schema
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl version should check is all data is printed [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Proxy server should support --unix-socket=/path [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should contain last line of the log
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should return command exit codes [Slow] running a failing command with --leave-stdin-open
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a failing command
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should return command exit codes running a failing command
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support exec through an HTTP proxy
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support exec using resource/name
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support inline execution and attach
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support port-forward
Kubernetes e2e suite [sig-cli] Kubectl client Update Demo should create and stop a replication controller [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Update Demo should scale a replication controller [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client kubectl wait should ignore not found error with --for=delete
Kubernetes e2e suite [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] each node by switching off the network interface and ensure they function upon switch on
Kubernetes e2e suite [sig-cloud-provider-gcp] Restart [Disruptive] should restart all nodes and ensure all nodes and pods recover
Kubernetes e2e suite [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] cluster upgrade should maintain a functioning cluster [Feature:ClusterUpgrade]
Kubernetes e2e suite [sig-cloud-provider] [Feature:CloudProvider][Disruptive] Nodes should be deleted on API server if it doesn't exist in the cloud provider
Kubernetes e2e suite [sig-cluster-lifecycle] [Feature:BootstrapTokens] should delete the signed bootstrap tokens from clusterInfo ConfigMap when bootstrap token is deleted
Kubernetes e2e suite [sig-cluster-lifecycle] [Feature:BootstrapTokens] should delete the token secret when the secret expired
Kubernetes e2e suite [sig-cluster-lifecycle] [Feature:BootstrapTokens] should resign the bootstrap tokens when the clusterInfo ConfigMap updated [Serial][Disruptive]
Kubernetes e2e suite [sig-cluster-lifecycle] [Feature:BootstrapTokens] should sign the new added bootstrap tokens
Kubernetes e2e suite [sig-instrumentation] Events should delete a collection of events [Conformance]
Kubernetes e2e suite [sig-instrumentation] Events should ensure that an event can be fetched, patched, deleted, and listed [Conformance]
Kubernetes e2e suite [sig-instrumentation] Stackdriver Monitoring should have accelerator metrics [Feature:StackdriverAcceleratorMonitoring]
Kubernetes e2e suite [sig-network] CVE-2021-29923 IPv4 Service Type ClusterIP with leading zeros should work interpreted as decimal
Kubernetes e2e suite [sig-network] Conntrack should be able to preserve UDP traffic when initial unready endpoints get ready
Kubernetes e2e suite [sig-network] Conntrack should drop INVALID conntrack entries [Privileged]
Kubernetes e2e suite [sig-network] DNS configMap nameserver Change stubDomain should be able to change stubDomain configuration [Slow][Serial]
Kubernetes e2e suite [sig-network] DNS should provide DNS for services [Conformance]
Kubernetes e2e suite [sig-network] DNS should provide DNS for the cluster [Provider:GCE]
Kubernetes e2e suite [sig-network] EndpointSlice should have Endpoints and EndpointSlices pointing to API Server [Conformance]
Kubernetes e2e suite [sig-network] EndpointSlice should support creating EndpointSlice API operations [Conformance]
Kubernetes e2e suite [sig-network] LoadBalancers ESIPP [Slow] should only target nodes with endpoints
Kubernetes e2e suite [sig-network] LoadBalancers ESIPP [Slow] should work from pods
Kubernetes e2e suite [sig-network] LoadBalancers should be able to change the type and ports of a UDP service [Slow]
Kubernetes e2e suite [sig-network] LoadBalancers should handle load balancer cleanup finalizer for service [Slow]
Kubernetes e2e suite [sig-network] LoadBalancers should have session affinity work for LoadBalancer service with ESIPP on [Slow] [DisabledForLargeClusters] [LinuxOnly]
Kubernetes e2e suite [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:Ingress] should conform to Ingress spec
Kubernetes e2e suite [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] [Flaky] should conform to Ingress spec
Kubernetes e2e suite [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] [Flaky] should sync endpoints to NEG
Kubernetes e2e suite [sig-network] Netpol API should support creating NetworkPolicy with Status subresource [Feature:NetworkPolicyStatus]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should enforce egress policy allowing traffic to a server in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should enforce except clause while egress access to server in CIDR block [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should enforce ingress policy allowing any port traffic to a server on a specific protocol [Feature:NetworkPolicy] [Feature:UDP]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should enforce multiple ingress policies with ingress allow-all policy taking precedence [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow ingress traffic from pods in all namespaces [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow traffic based on NamespaceSelector with MatchLabels using default ns label [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow traffic from pods within server namespace based on PodSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should enforce updated policy [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should not allow access by TCP when a policy specifies only UDP [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should support denying of egress traffic on the client side (even if the server explicitly allows this traffic) [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should work with Ingress, Egress specified together [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicy [Feature:SCTPConnectivity][LinuxOnly][Disruptive] NetworkPolicy between server and client using SCTP should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow ingress access from namespace on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should deny ingress access to updated pod [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on Ports [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy to allow traffic only from a different namespace, based on NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce updated policy [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should ensure an IP overlapping both IPBlock.CIDR and IPBlock.Except is allowed [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should stop enforcing policies after they are deleted [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should support a 'default-deny-ingress' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should support allow-all policy [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: http [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: udp [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Pods should function for node-pod communication: http [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for endpoint-Service: udp
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for multiple endpoint-Services with same selector
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for node-Service: udp
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for pod-Service: http
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for service endpoints using hostNetwork
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should update endpoints: http
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should update nodePort: http [Slow]
Kubernetes e2e suite [sig-network] Networking should provide Internet connection for containers [Feature:Networking-IPv4]
Kubernetes e2e suite [sig-network] Networking should provide unchanging, static URL paths for kubernetes api services
Kubernetes e2e suite [sig-network] Proxy version v1 should proxy through a service and a pod [Conformance]
Kubernetes e2e suite [sig-network] SCTP [LinuxOnly] should allow creating a basic SCTP service with pod and endpoints
Kubernetes e2e suite [sig-network] Service endpoints latency should not be very high [Conformance]
Kubernetes e2e suite [sig-network] Services should allow pods to hairpin back to themselves through services
Kubernetes e2e suite [sig-network] Services should be able to change the type from ExternalName to ClusterIP [Conformance]
Kubernetes e2e suite [sig-network] Services should be able to create a functioning NodePort service [Conformance]
Kubernetes e2e suite [sig-network] Services should be able to switch session affinity for service with type clusterIP [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] Services should be able to up and down services
Kubernetes e2e suite [sig-network] Services should be able to update service type to NodePort listening on same port number but different protocols
Kubernetes e2e suite [sig-network] Services should be possible to connect to a service via ExternalIP when the external IP is not assigned to a node
Kubernetes e2e suite [sig-network] Services should delete a collection of services [Conformance]
Kubernetes e2e suite [sig-network] Services should fail health check node port if there are only terminating endpoints [Feature:ProxyTerminatingEndpoints]
Kubernetes e2e suite [sig-network] Services should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] Services should implement service.kubernetes.io/headless
Kubernetes e2e suite [sig-network] Services should implement service.kubernetes.io/service-proxy-name
Kubernetes e2e suite [sig-network] Services should release NodePorts on delete
Kubernetes e2e suite [sig-network] Services should respect internalTrafficPolicy=Local Pod (hostNetwork: true) to Pod [Feature:ServiceInternalTrafficPolicy]
Kubernetes e2e suite [sig-network] Services should respect internalTrafficPolicy=Local Pod and Node, to Pod (hostNetwork: true) [Feature:ServiceInternalTrafficPolicy]
Kubernetes e2e suite [sig-network] Services should serve a basic endpoint from pods [Conformance]
Kubernetes e2e suite [sig-network] Services should serve multiport endpoints from pods [Conformance]
Kubernetes e2e suite [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should be able to handle large requests: http
Kubernetes e2e suite [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for endpoint-Service: http
Kubernetes e2e suite [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for node-Service: udp
Kubernetes e2e suite [sig-network] [Feature:IPv6DualStack] should create service with ipv4 cluster ip
Kubernetes e2e suite [sig-network] [Feature:IPv6DualStack] should create service with ipv4,v6 cluster ip
Kubernetes e2e suite [sig-network] [Feature:IPv6DualStack] should have ipv4 and ipv6 internal node ip
Kubernetes e2e suite [sig-network] kube-proxy migration [Feature:KubeProxyDaemonSetMigration] Downgrade kube-proxy from a DaemonSet to static pods should maintain a functioning cluster [Feature:KubeProxyDaemonSetDowngrade]
Kubernetes e2e suite [sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart exec hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart http hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull from private registry with secret [NodeConformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test when starting a container that exits should run with the expected status [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Containers should use the image defaults if command and args are blank [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Downward API [Serial] [Disruptive] [NodeFeature:DownwardAPIHugePages] Downward API tests for hugepages should provide container's limits.hugepages-<pagesize> and requests.hugepages-<pagesize> as env vars
Kubernetes e2e suite [sig-node] Downward API should provide host IP and pod IP as an env var if pod uses host network [LinuxOnly]
Kubernetes e2e suite [sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Downward API should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]
Kubernetes e2e suite [sig-node] InitContainer [NodeConformance] should invoke init containers on a RestartNever pod [Conformance]
Kubernetes e2e suite [sig-node] KubeletManagedEtcHosts should test kubelet managed /etc/hosts file [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Mount propagation should propagate mounts within defined scopes
Kubernetes e2e suite [sig-node] NoExecuteTaintManager Multiple Pods [Serial] only evicts pods without tolerations from tainted nodes
Kubernetes e2e suite [sig-node] NoExecuteTaintManager Single Pod [Serial] evicts pods from tainted nodes
Kubernetes e2e suite [sig-node] NodeLease NodeLease should have OwnerReferences set
Kubernetes e2e suite [sig-node] PodTemplates should delete a collection of pod templates [Conformance]
Kubernetes e2e suite [sig-node] Pods Extended Pod Container Status should never report container start when an init container fails
Kubernetes e2e suite [sig-node] Pods should be submitted and removed [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Pods should cap back-off at MaxContainerBackOff [Slow][NodeConformance]
Kubernetes e2e suite [sig-node] Pods should contain environment variables for services [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Pods should delete a collection of pods [Conformance]
Kubernetes e2e suite [sig-node] PreStop graceful pod terminated should wait until preStop hook completes the process
Kubernetes e2e suite [sig-node] PreStop should call prestop when killing a pod [Conformance]
Kubernetes e2e suite [sig-node] Probing container should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should *not* be restarted with a tcp:8080 liveness probe [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should be ready immediately after startupProbe succeeds
Kubernetes e2e suite [sig-node] Probing container should be restarted startup probe fails
Kubernetes e2e suite [sig-node] Probing container should be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should be restarted with a local redirect http liveness probe
Kubernetes e2e suite [sig-node] Probing container should mark readiness on pods to false while pod is in progress of terminating when a pod has a readiness probe
Kubernetes e2e suite [sig-node] Probing container with readiness probe should not be ready before initial delay and never restart [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] RuntimeClass should reject a Pod requesting a RuntimeClass with an unconfigured handler [NodeFeature:RuntimeHandler]
Kubernetes e2e suite [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler]
Kubernetes e2e suite [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with scheduling with taints [Serial]
Kubernetes e2e suite [sig-node] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Secrets should patch a secret [Conformance]
Kubernetes e2e suite [sig-node] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Security Context When creating a pod with readOnlyRootFilesystem should run the container with readonly rootfs when readOnlyRootFilesystem=true [LinuxOnly] [NodeConformance]
Kubernetes e2e suite [sig-node] Security Context When creating a pod with readOnlyRootFilesystem should run the container with writable rootfs when readOnlyRootFilesystem=false [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Security Context should support seccomp runtime/default [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context should support volume SELinux relabeling when using hostIPC [Flaky] [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context should support volume SELinux relabeling when using hostPID [Flaky] [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should allow privilege escalation when true [LinuxOnly] [NodeConformance]
Kubernetes e2e suite [sig-node] Sysctls [LinuxOnly] [NodeConformance] should not launch unsafe, but not explicitly enabled sysctls on the node [MinimumKubeletVersion:1.21]
Kubernetes e2e suite [sig-node] Sysctls [LinuxOnly] [NodeConformance] should support sysctls [MinimumKubeletVersion:1.21] [Conformance]
Kubernetes e2e suite [sig-node] Variable Expansion should fail substituting values in a volume subpath with absolute path [Slow] [Conformance]
Kubernetes e2e suite [sig-node] Variable Expansion should fail substituting values in a volume subpath with backticks [Slow] [Conformance]
Kubernetes e2e suite [sig-node] [Feature:Example] Liveness liveness pods should be automatically restarted
Kubernetes e2e suite [sig-node] gpu Upgrade [Feature:GPUUpgrade] cluster upgrade should be able to run gpu pod after upgrade [Feature:GPUClusterUpgrade]
Kubernetes e2e suite [sig-scheduling] Multi-AZ Clusters should spread the pods of a service across zones [Serial]
Kubernetes e2e suite [sig-scheduling] SchedulerPredicates [Serial] validates that NodeSelector is respected if not matching [Conformance]
Kubernetes e2e suite [sig-scheduling] SchedulerPredicates [Serial] validates that required NodeAffinity setting is respected if matching
Kubernetes e2e suite [sig-scheduling] SchedulerPredicates [Serial] validates that taints-tolerations is respected if matching
Kubernetes e2e suite [sig-scheduling] SchedulerPreemption [Serial] PodTopologySpread Preemption validates proper pods are preempted
Kubernetes e2e suite [sig-scheduling] SchedulerPreemption [Serial] PriorityClass endpoints verify PriorityClass endpoints can be operated with different HTTP methods [Conformance]
Kubernetes e2e suite [sig-scheduling] SchedulerPreemption [Serial] validates lower priority pod preemption by critical pod [Conformance]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] volume-lifecycle-performance should provision volumes at scale within performance constraints [Slow] [Serial]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should verify that all csinodes have volume limits
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works, check deletion (ephemeral)
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits should verify that all csinodes have volume limits
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works, check deletion (ephemeral)
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits should verify that all csinodes have volume limits
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works, check deletion (ephemeral)
Kubernetes e2e suite [sig-storage] CSI mock volume CSI FSGroupPolicy [LinuxOnly] should modify fsGroup if fsGroupPolicy=File
Kubernetes e2e suite [sig-storage] CSI mock volume CSI FSGroupPolicy [LinuxOnly] should not modify fsGroup if fsGroupPolicy=None
Kubernetes e2e suite [sig-storage] CSI mock volume CSI NodeStage error cases [Slow] should retry NodeStage after NodeStage final error
Kubernetes e2e suite [sig-storage] CSI mock volume CSI Volume expansion should not expand volume if resizingOnDriver=off, resizingOnSC=on
Kubernetes e2e suite [sig-storage] CSI mock volume CSI workload information using mock driver should not be passed when podInfoOnMount=nil
Kubernetes e2e suite [sig-storage] CSI mock volume CSIServiceAccountToken token should be plumbed down when csiServiceAccountTokenEnabled=true
Kubernetes e2e suite [sig-storage] CSI mock volume CSIServiceAccountToken token should not be plumbed down when csiServiceAccountTokenEnabled=false
Kubernetes e2e suite [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity disabled
Kubernetes e2e suite [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity unused
Kubernetes e2e suite [sig-storage] CSIStorageCapacity should support CSIStorageCapacities API operations [Conformance]
Kubernetes e2e suite [sig-storage] ConfigMap Should fail non-optional pod creation due to configMap object does not exist [Slow]
Kubernetes e2e suite [sig-storage] ConfigMap optional updates should be reflected in volume [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] ConfigMap should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeFeature:FSGroup]
Kubernetes e2e suite [sig-storage] ConfigMap should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] Downward API [Serial] [Disruptive] [Feature:EphemeralStorage] Downward API tests for local ephemeral storage should provide container's limits.ephemeral-storage and requests.ephemeral-storage as env vars
Kubernetes e2e suite [sig-storage] Downward API volume should provide container's cpu request [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] Downward API volume should provide node allocatable (cpu) as default cpu limit if the limit is not set [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] Downward API volume should provide podname as non-root with fsgroup and defaultMode [LinuxOnly] [NodeFeature:FSGroup]
Kubernetes e2e suite [sig-storage] Downward API volume should provide podname only [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] Downward API volume should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] Dynamic Provisioning DynamicProvisioner Default should be disabled by removing the default annotation [Serial] [Disruptive]
Kubernetes e2e suite [sig-storage] Dynamic Provisioning DynamicProvisioner Default should create and delete default persistent volumes [Slow]
Kubernetes e2e suite [sig-storage] Dynamic Provisioning DynamicProvisioner [Slow] [Feature:StorageProvider] should provision storage with non-default reclaim policy Retain
Kubernetes e2e suite [sig-storage] Dynamic Provisioning DynamicProvisioner [Slow] [Feature:StorageProvider] should test that deleting a claim before the volume is provisioned deletes the volume.
Kubernetes e2e suite [sig-storage] Dynamic Provisioning GlusterDynamicProvisioner should create and delete persistent volumes [fast]
Kubernetes e2e suite [sig-storage] EmptyDir volumes pod should support shared volumes between containers [Conformance]
Kubernetes e2e suite [sig-storage] EmptyDir volumes should support (non-root,0644,default) [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] EmptyDir volumes should support (non-root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] EmptyDir volumes should support (non-root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] EmptyDir volumes should support (non-root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] EmptyDir volumes should support (root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] files with FSGroup ownership should support (root,0644,tmpfs)
Kubernetes e2e suite [sig-storage] EmptyDir wrapper volumes should not cause race condition when used for git_repo [Serial] [Slow]
Kubernetes e2e suite [sig-storage] Flexvolumes should be mountable when non-attachable
Kubernetes e2e suite [sig-storage] GKE local SSD [Feature:GKELocalSSD] should write and read from node local SSD [Feature:GKELocalSSD]
Kubernetes e2e suite [sig-storage] HostPath should support subPath [NodeConformance]
Kubernetes e2e suite [sig-storage] HostPathType Block Device [Slow] Should fail on mounting block device 'ablkdev' when HostPathType is HostPathCharDev
Kubernetes e2e suite [sig-storage] HostPathType Character Device [Slow] Should fail on mounting character device 'achardev' when HostPathType is HostPathDirectory
Kubernetes e2e suite [sig-storage] HostPathType Character Device [Slow] Should fail on mounting character device 'achardev' when HostPathType is HostPathFile
Kubernetes e2e suite [sig-storage] HostPathType Directory [Slow] Should be able to mount directory 'adir' successfully when HostPathType is HostPathDirectory
Kubernetes e2e suite [sig-storage] HostPathType Directory [Slow] Should be able to mount directory 'adir' successfully when HostPathType is HostPathUnset
Kubernetes e2e suite [sig-storage] HostPathType Directory [Slow] Should fail on mounting directory 'adir' when HostPathType is HostPathBlockDev
Kubernetes e2e suite [sig-storage] HostPathType Directory [Slow] Should fail on mounting directory 'adir' when HostPathType is HostPathCharDev
Kubernetes e2e suite [sig-storage] HostPathType File [Slow] Should be able to mount file 'afile' successfully when HostPathType is HostPathFile
Kubernetes e2e suite [sig-storage] HostPathType File [Slow] Should be able to mount file 'afile' successfully when HostPathType is HostPathUnset
Kubernetes e2e suite [sig-storage] HostPathType File [Slow] Should fail on mounting file 'afile' when HostPathType is HostPathBlockDev
Kubernetes e2e suite [sig-storage] HostPathType Socket [Slow] Should fail on mounting socket 'asocket' when HostPathType is HostPathDirectory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup skips ownership changes to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (delayed binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits should verify that all csinodes have volume limits
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (ext3)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (block volmode)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] capacity provides storage capacity information
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup skips ownership changes to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with mount options
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should verify that all csinodes have volume limits
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (immediate binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (xfs)][Slow] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail in binding dynamic provisioned PV to PVC [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] capacity provides storage capacity information
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (xfs)][Slow] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] capacity provides storage capacity information
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup skips ownership changes to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with mount options
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits should support volume limits [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Inline-volume (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Inline-volume (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Inline-volume (ext3)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Inline-volume (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Inline-volume (xfs)][Slow] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to create pod by failing to mount volume [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup skips ownership changes to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should verify that all csinodes have volume limits
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (immediate binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with mount options
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits should support volume limits [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits should verify that all csinodes have volume limits
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup skips ownership changes to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with mount options
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (delayed binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with mount options
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access t