ci-kubernetes-e2e-snapshot #1538397983865835520
Recent runs || View in Spyglass
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\scsi\-hostpath\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\]\smultiVolume\s\[Slow\]\sshould\sconcurrently\saccess\sthe\svolume\sand\srestored\ssnapshot\sfrom\spods\son\sthe\ssame\snode\s\[LinuxOnly\]\[Feature\:VolumeSnapshotDataSource\]\[Feature\:VolumeSourceXFS\]$'
test/e2e/storage/testsuites/multivolume.go:323 Jun 19 07:29:01.468: VolumeSnapshot snapshot-b99kr is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 19 07:23:33.528: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename multivolume �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS] test/e2e/storage/testsuites/multivolume.go:323 �[1mSTEP�[0m: Building a driver namespace object, basename multivolume-6198 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi-hostpath driver Jun 19 07:23:34.109: INFO: creating *v1.ServiceAccount: multivolume-6198-7187/csi-attacher Jun 19 07:23:34.161: INFO: creating *v1.ClusterRole: external-attacher-runner-multivolume-6198 Jun 19 07:23:34.161: INFO: Define cluster role external-attacher-runner-multivolume-6198 Jun 19 07:23:34.207: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-multivolume-6198 Jun 19 07:23:34.243: INFO: creating *v1.Role: multivolume-6198-7187/external-attacher-cfg-multivolume-6198 Jun 19 07:23:34.280: INFO: creating *v1.RoleBinding: multivolume-6198-7187/csi-attacher-role-cfg Jun 19 07:23:34.317: INFO: creating *v1.ServiceAccount: multivolume-6198-7187/csi-provisioner Jun 19 07:23:34.353: INFO: creating *v1.ClusterRole: external-provisioner-runner-multivolume-6198 Jun 19 07:23:34.353: INFO: Define cluster role external-provisioner-runner-multivolume-6198 Jun 19 07:23:34.392: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-multivolume-6198 Jun 19 07:23:34.431: INFO: creating *v1.Role: multivolume-6198-7187/external-provisioner-cfg-multivolume-6198 Jun 19 07:23:34.467: INFO: creating *v1.RoleBinding: multivolume-6198-7187/csi-provisioner-role-cfg Jun 19 07:23:34.503: INFO: creating *v1.ServiceAccount: multivolume-6198-7187/csi-snapshotter Jun 19 07:23:34.540: INFO: creating *v1.ClusterRole: external-snapshotter-runner-multivolume-6198 Jun 19 07:23:34.540: INFO: Define cluster role external-snapshotter-runner-multivolume-6198 Jun 19 07:23:34.576: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-multivolume-6198 Jun 19 07:23:34.613: INFO: creating *v1.Role: multivolume-6198-7187/external-snapshotter-leaderelection-multivolume-6198 Jun 19 07:23:34.650: INFO: creating *v1.RoleBinding: multivolume-6198-7187/external-snapshotter-leaderelection Jun 19 07:23:34.686: INFO: creating *v1.ServiceAccount: multivolume-6198-7187/csi-external-health-monitor-controller Jun 19 07:23:34.723: INFO: creating *v1.ClusterRole: external-health-monitor-controller-runner-multivolume-6198 Jun 19 07:23:34.723: INFO: Define cluster role external-health-monitor-controller-runner-multivolume-6198 Jun 19 07:23:34.761: INFO: creating *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-multivolume-6198 Jun 19 07:23:34.798: INFO: creating *v1.Role: multivolume-6198-7187/external-health-monitor-controller-cfg-multivolume-6198 Jun 19 07:23:34.834: INFO: creating *v1.RoleBinding: multivolume-6198-7187/csi-external-health-monitor-controller-role-cfg Jun 19 07:23:34.870: INFO: creating *v1.ServiceAccount: multivolume-6198-7187/csi-resizer Jun 19 07:23:34.907: INFO: creating *v1.ClusterRole: external-resizer-runner-multivolume-6198 Jun 19 07:23:34.907: INFO: Define cluster role external-resizer-runner-multivolume-6198 Jun 19 07:23:34.943: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-multivolume-6198 Jun 19 07:23:34.980: INFO: creating *v1.Role: multivolume-6198-7187/external-resizer-cfg-multivolume-6198 Jun 19 07:23:35.016: INFO: creating *v1.RoleBinding: multivolume-6198-7187/csi-resizer-role-cfg Jun 19 07:23:35.053: INFO: creating *v1.CSIDriver: csi-hostpath-multivolume-6198 Jun 19 07:23:35.090: INFO: creating *v1.ServiceAccount: multivolume-6198-7187/csi-hostpathplugin-sa Jun 19 07:23:35.127: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-multivolume-6198 Jun 19 07:23:35.164: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-multivolume-6198 Jun 19 07:23:35.201: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-multivolume-6198 Jun 19 07:23:35.268: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-multivolume-6198 Jun 19 07:23:35.316: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-multivolume-6198 Jun 19 07:23:35.352: INFO: creating *v1.RoleBinding: multivolume-6198-7187/csi-hostpathplugin-attacher-role Jun 19 07:23:35.390: INFO: creating *v1.RoleBinding: multivolume-6198-7187/csi-hostpathplugin-health-monitor-controller-role Jun 19 07:23:35.427: INFO: creating *v1.RoleBinding: multivolume-6198-7187/csi-hostpathplugin-provisioner-role Jun 19 07:23:35.464: INFO: creating *v1.RoleBinding: multivolume-6198-7187/csi-hostpathplugin-resizer-role Jun 19 07:23:35.501: INFO: creating *v1.RoleBinding: multivolume-6198-7187/csi-hostpathplugin-snapshotter-role Jun 19 07:23:35.538: INFO: creating *v1.StatefulSet: multivolume-6198-7187/csi-hostpathplugin Jun 19 07:23:35.582: INFO: creating *v1.ClusterRoleBinding: psp-csi-hostpath-role-multivolume-6198 Jun 19 07:23:35.633: INFO: Creating resource for dynamic PV Jun 19 07:23:35.634: INFO: Using claimSize:1Mi, test suite supported size:{ 1Mi}, driver(csi-hostpath) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass multivolume-6198xxmrs �[1mSTEP�[0m: creating a claim Jun 19 07:23:35.719: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [csi-hostpathtvclh] to have phase Bound Jun 19 07:23:35.754: INFO: PersistentVolumeClaim csi-hostpathtvclh found but phase is Pending instead of Bound. Jun 19 07:23:37.792: INFO: PersistentVolumeClaim csi-hostpathtvclh found but phase is Pending instead of Bound. Jun 19 07:23:39.828: INFO: PersistentVolumeClaim csi-hostpathtvclh found but phase is Pending instead of Bound. Jun 19 07:23:41.863: INFO: PersistentVolumeClaim csi-hostpathtvclh found but phase is Pending instead of Bound. Jun 19 07:23:43.898: INFO: PersistentVolumeClaim csi-hostpathtvclh found and phase=Bound (8.178885628s) �[1mSTEP�[0m: Storage class multivolume-6198xxmrs is already created, skipping creation. �[1mSTEP�[0m: Skipping creation of PVC, it already exists �[1mSTEP�[0m: starting hostpath-injector Jun 19 07:23:44.041: INFO: Waiting up to 5m0s for pod "hostpath-injector" in namespace "multivolume-6198" to be "running" Jun 19 07:23:44.086: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 45.143433ms Jun 19 07:23:46.124: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.08280327s Jun 19 07:23:48.123: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.082097825s Jun 19 07:23:50.123: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.081571638s Jun 19 07:23:52.122: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.081296049s Jun 19 07:23:54.122: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 10.081042424s Jun 19 07:23:56.123: INFO: Pod "hostpath-injector": Phase="Running", Reason="", readiness=true. Elapsed: 12.082122911s Jun 19 07:23:56.123: INFO: Pod "hostpath-injector" satisfied condition "running" �[1mSTEP�[0m: Writing text file contents in the container. Jun 19 07:23:56.123: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.127.118.154 --kubeconfig=/workspace/.kube/config --namespace=multivolume-6198 exec hostpath-injector --namespace=multivolume-6198 -- /bin/sh -c echo 'volume content 1655623423968967845' > /opt/0' Jun 19 07:23:56.625: INFO: stderr: "" Jun 19 07:23:56.625: INFO: stdout: "" �[1mSTEP�[0m: Checking that text file contents are perfect. Jun 19 07:23:56.625: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.127.118.154 --kubeconfig=/workspace/.kube/config --namespace=multivolume-6198 exec hostpath-injector --namespace=multivolume-6198 -- head -c 34 /opt/0' Jun 19 07:23:57.102: INFO: stderr: "" Jun 19 07:23:57.102: INFO: stdout: "volume content 1655623423968967845" Jun 19 07:23:57.102: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:multivolume-6198 PodName:hostpath-injector ContainerName:hostpath-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 19 07:23:57.102: INFO: >>> kubeConfig: /workspace/.kube/config Jun 19 07:23:57.103: INFO: ExecWithOptions: Clientset creation Jun 19 07:23:57.104: INFO: ExecWithOptions: execute(POST https://34.127.118.154/api/v1/namespaces/multivolume-6198/pods/hostpath-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=hostpath-injector&container=hostpath-injector&stderr=true&stdout=true) Jun 19 07:23:57.436: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:multivolume-6198 PodName:hostpath-injector ContainerName:hostpath-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 19 07:23:57.436: INFO: >>> kubeConfig: /workspace/.kube/config Jun 19 07:23:57.438: INFO: ExecWithOptions: Clientset creation Jun 19 07:23:57.438: INFO: ExecWithOptions: execute(POST https://34.127.118.154/api/v1/namespaces/multivolume-6198/pods/hostpath-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=hostpath-injector&container=hostpath-injector&stderr=true&stdout=true) �[1mSTEP�[0m: Deleting pod hostpath-injector in namespace multivolume-6198 Jun 19 07:23:57.755: INFO: Waiting for pod hostpath-injector to disappear Jun 19 07:23:57.790: INFO: Pod hostpath-injector still exists Jun 19 07:23:59.790: INFO: Waiting for pod hostpath-injector to disappear Jun 19 07:23:59.825: INFO: Pod hostpath-injector no longer exists �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 19 07:23:59.941: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-b99kr to become ready Jun 19 07:23:59.985: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:02.021: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:04.058: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:06.096: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:08.134: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:10.172: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:12.210: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:14.246: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:16.283: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:18.319: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:20.357: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:22.394: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:24.432: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:26.470: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:28.507: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:30.544: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:32.581: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:34.618: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:36.655: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:38.692: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:40.729: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:42.767: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:44.804: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:46.840: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:48.877: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:50.914: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:52.952: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:54.989: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:57.031: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:24:59.067: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:01.104: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:03.141: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:05.177: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:07.213: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:09.251: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:11.288: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:13.326: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:15.363: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:17.399: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:19.436: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:21.472: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:23.508: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:25.545: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:27.583: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:29.624: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:31.662: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:33.701: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:35.738: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:37.775: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:39.816: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:41.852: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:43.890: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:45.926: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:47.965: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:50.002: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:52.039: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:54.076: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:56.113: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:25:58.150: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:00.187: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:02.225: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:04.262: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:06.299: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:08.336: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:10.374: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:12.412: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:14.449: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:16.486: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:18.524: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:20.561: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:22.600: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:24.638: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:26.675: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:28.712: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:30.749: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:32.786: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:34.822: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:36.858: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:38.894: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:40.931: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:42.969: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:45.005: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:47.043: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:49.081: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:51.117: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:53.155: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:55.192: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:57.229: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:26:59.265: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:01.302: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:03.338: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:05.376: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:07.414: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:09.450: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:11.487: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:13.524: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:15.562: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:17.598: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:19.647: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:21.683: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:23.720: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:25.756: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:27.794: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:29.830: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:31.868: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:33.906: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:35.943: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:37.981: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:40.018: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:42.055: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:44.092: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:46.129: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:48.165: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:50.203: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:52.240: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:54.278: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:56.315: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:27:58.351: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:00.388: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:02.427: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:04.463: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:06.502: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:08.540: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:10.577: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:12.614: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:14.651: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:16.689: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:18.726: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:20.763: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:22.799: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:24.836: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:26.872: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:28.909: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:30.945: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:32.983: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:35.021: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:37.057: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:39.096: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:41.133: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:43.170: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:45.208: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:47.245: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:49.281: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:51.319: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:53.355: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:55.392: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:57.431: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:28:59.467: INFO: VolumeSnapshot snapshot-b99kr found but is not ready. Jun 19 07:29:01.468: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 19 07:29:01.468: INFO: Unexpected error: <*errors.errorString | 0xc002753290>: { s: "VolumeSnapshot snapshot-b99kr is not ready within 5m0s", } Jun 19 07:29:01.468: FAIL: VolumeSnapshot snapshot-b99kr is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc0031040f0?}, 0xc00195cbf8) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f9d66eec7d8, 0xc0010b5c00}, 0xc0034ed320, {{0x71975b3, 0x1a}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage/testsuites.prepareSnapshotDataSourceForProvisioning(_, {{0xc003427ac0, 0x10}, {0x713b04a, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...) test/e2e/storage/testsuites/provisioning.go:1090 +0x41f k8s.io/kubernetes/test/e2e/storage/testsuites.(*multiVolumeTestSuite).DefineTests.func8() test/e2e/storage/testsuites/multivolume.go:348 +0x613 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Creating pod1 with a volume on {Name:bootstrap-e2e-minion-group-qcp1 Selector:map[] Affinity:nil} Jun 19 07:29:01.547: INFO: Waiting up to 5m0s for pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7" in namespace "multivolume-6198" to be "running" Jun 19 07:29:01.740: INFO: Pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7": Phase="Pending", Reason="", readiness=false. Elapsed: 193.039897ms Jun 19 07:29:03.778: INFO: Pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.230956956s Jun 19 07:29:05.789: INFO: Pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.242219547s Jun 19 07:29:07.780: INFO: Pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.233363984s Jun 19 07:29:09.777: INFO: Pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.230723602s Jun 19 07:29:11.777: INFO: Pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7": Phase="Pending", Reason="", readiness=false. Elapsed: 10.230111384s Jun 19 07:29:13.778: INFO: Pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7": Phase="Pending", Reason="", readiness=false. Elapsed: 12.231099576s Jun 19 07:29:15.777: INFO: Pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7": Phase="Pending", Reason="", readiness=false. Elapsed: 14.229984901s Jun 19 07:29:17.777: INFO: Pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7": Phase="Pending", Reason="", readiness=false. Elapsed: 16.230707686s Jun 19 07:29:19.777: INFO: Pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7": Phase="Running", Reason="", readiness=true. Elapsed: 18.230194594s Jun 19 07:29:19.777: INFO: Pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7" satisfied condition "running" �[1mSTEP�[0m: Creating pod2 with a volume on {Name:bootstrap-e2e-minion-group-qcp1 Selector:map[] Affinity:&Affinity{NodeAffinity:&NodeAffinity{RequiredDuringSchedulingIgnoredDuringExecution:&NodeSelector{NodeSelectorTerms:[]NodeSelectorTerm{NodeSelectorTerm{MatchExpressions:[]NodeSelectorRequirement{},MatchFields:[]NodeSelectorRequirement{NodeSelectorRequirement{Key:metadata.name,Operator:In,Values:[bootstrap-e2e-minion-group-qcp1],},},},},},PreferredDuringSchedulingIgnoredDuringExecution:[]PreferredSchedulingTerm{},},PodAffinity:nil,PodAntiAffinity:nil,}} Jun 19 07:29:19.854: INFO: Waiting up to 5m0s for pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a" in namespace "multivolume-6198" to be "running" Jun 19 07:29:19.889: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 35.244552ms Jun 19 07:29:21.927: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.073140381s Jun 19 07:29:23.925: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.071112957s Jun 19 07:29:25.926: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 6.071977537s Jun 19 07:29:27.926: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 8.071903186s Jun 19 07:29:29.926: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 10.071671026s Jun 19 07:29:31.925: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 12.070902346s Jun 19 07:29:33.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 14.086648644s Jun 19 07:29:35.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 16.08828891s Jun 19 07:29:37.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 18.088252804s Jun 19 07:29:39.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 20.087338603s Jun 19 07:29:41.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 22.088105891s Jun 19 07:29:43.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 24.087859526s Jun 19 07:29:45.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 26.088212597s Jun 19 07:29:47.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 28.089261106s Jun 19 07:29:49.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 30.087103044s Jun 19 07:29:51.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 32.087569615s Jun 19 07:29:53.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 34.088245309s Jun 19 07:29:55.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 36.087521733s Jun 19 07:29:57.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 38.088322482s Jun 19 07:29:59.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 40.08718933s Jun 19 07:30:01.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 42.087684896s Jun 19 07:30:03.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 44.087610977s Jun 19 07:30:05.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 46.086927709s Jun 19 07:30:07.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 48.089052891s Jun 19 07:30:09.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 50.087138231s Jun 19 07:30:11.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 52.087447359s Jun 19 07:30:13.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 54.086644848s Jun 19 07:30:15.947: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 56.093217745s Jun 19 07:30:17.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 58.088482693s Jun 19 07:30:19.946: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.091505234s Jun 19 07:30:21.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.087166539s Jun 19 07:30:23.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.087347589s Jun 19 07:30:25.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.087274044s Jun 19 07:30:27.944: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.089475286s Jun 19 07:30:29.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.087245413s Jun 19 07:30:31.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.087212121s Jun 19 07:30:33.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.087169919s Jun 19 07:30:35.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.088235365s Jun 19 07:30:37.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.088784837s Jun 19 07:30:39.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.088082676s Jun 19 07:30:41.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.087486685s Jun 19 07:30:43.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.087255272s Jun 19 07:30:45.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.08775856s Jun 19 07:30:47.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.08884125s Jun 19 07:30:49.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.087841048s Jun 19 07:30:51.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.088020544s Jun 19 07:30:53.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.087566079s Jun 19 07:30:55.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.08711157s Jun 19 07:30:57.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.087865905s Jun 19 07:30:59.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.087951836s Jun 19 07:31:01.948: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.093922416s Jun 19 07:31:03.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.088199671s Jun 19 07:31:05.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.087471534s Jun 19 07:31:07.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.088171601s Jun 19 07:31:09.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.087420852s Jun 19 07:31:11.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.087994009s Jun 19 07:31:13.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.08784235s Jun 19 07:31:15.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.088305226s Jun 19 07:31:17.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.088679212s Jun 19 07:31:19.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.08775573s Jun 19 07:31:21.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.087690499s Jun 19 07:31:23.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.086822196s Jun 19 07:31:25.944: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.089991884s Jun 19 07:31:27.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.088567874s Jun 19 07:31:29.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.08813894s Jun 19 07:31:31.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.086902448s Jun 19 07:31:33.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.087126285s Jun 19 07:31:35.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.088211594s Jun 19 07:31:37.948: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.0935678s Jun 19 07:31:39.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.087135631s Jun 19 07:31:41.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.087735639s Jun 19 07:31:43.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.087538689s Jun 19 07:31:45.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.088598996s Jun 19 07:31:47.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.088011669s Jun 19 07:31:49.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.086548078s Jun 19 07:31:51.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.087155747s Jun 19 07:31:53.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.087662951s Jun 19 07:31:55.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.087097983s Jun 19 07:31:57.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.087150689s Jun 19 07:31:59.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.087179479s Jun 19 07:32:01.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.088034969s Jun 19 07:32:03.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.087806851s Jun 19 07:32:05.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.086891963s Jun 19 07:32:07.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.08802382s Jun 19 07:32:09.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.087030226s Jun 19 07:32:11.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.087239443s Jun 19 07:32:13.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.087669942s Jun 19 07:32:15.926: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.071521687s Jun 19 07:32:17.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.088052169s Jun 19 07:32:19.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.08699462s Jun 19 07:32:21.946: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.091641482s Jun 19 07:32:23.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.087691893s Jun 19 07:32:25.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.087253169s Jun 19 07:32:27.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.088479348s Jun 19 07:32:29.960: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.105742983s Jun 19 07:32:31.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.087147916s Jun 19 07:32:33.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.087334712s Jun 19 07:32:35.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.088289636s Jun 19 07:32:37.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.087791025s Jun 19 07:32:39.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.087165959s Jun 19 07:32:41.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.087740476s Jun 19 07:32:43.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.088506799s Jun 19 07:32:45.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.087435083s Jun 19 07:32:47.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.087823053s Jun 19 07:32:49.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.087286766s Jun 19 07:32:51.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.08842803s Jun 19 07:32:53.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.087427634s Jun 19 07:32:55.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.088163083s Jun 19 07:32:57.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.087951253s Jun 19 07:32:59.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.087048003s Jun 19 07:33:01.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.087416152s Jun 19 07:33:03.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.086797241s Jun 19 07:33:05.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.087941728s Jun 19 07:33:07.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.087868228s Jun 19 07:33:09.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.087414121s Jun 19 07:33:11.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.087766935s Jun 19 07:33:13.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.088017532s Jun 19 07:33:15.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.087903019s Jun 19 07:33:17.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.089207736s Jun 19 07:33:19.944: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.090299438s Jun 19 07:33:21.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.089047651s Jun 19 07:33:23.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.087836318s Jun 19 07:33:25.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.087839897s Jun 19 07:33:27.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.088073662s Jun 19 07:33:29.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.087735203s Jun 19 07:33:31.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.086454996s Jun 19 07:33:33.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.088435377s Jun 19 07:33:35.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.088056461s Jun 19 07:33:37.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.088376635s Jun 19 07:33:39.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.087413505s Jun 19 07:33:41.925: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.070678233s Jun 19 07:33:43.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.087453306s Jun 19 07:33:45.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.087536575s Jun 19 07:33:47.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.088800879s Jun 19 07:33:49.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.0876813s Jun 19 07:33:51.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.08747066s Jun 19 07:33:53.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.087266549s Jun 19 07:33:55.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.087222861s Jun 19 07:33:57.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.088372237s Jun 19 07:33:59.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.086931727s Jun 19 07:34:01.998: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.144203833s Jun 19 07:34:03.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.087823112s Jun 19 07:34:05.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.08753274s Jun 19 07:34:07.943: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.088739769s Jun 19 07:34:09.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.087982293s Jun 19 07:34:11.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.086880827s Jun 19 07:34:13.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.088016055s Jun 19 07:34:15.941: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.087071153s Jun 19 07:34:17.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.088082532s Jun 19 07:34:19.942: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.08793082s Jun 19 07:34:20.041: INFO: Pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.187254204s Jun 19 07:34:20.041: INFO: Unexpected error: <*errors.errorString | 0xc000e0bd70>: { s: "pod \"pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a\" is not Running: timed out while waiting for pod multivolume-6198/pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a to be running", } Jun 19 07:34:20.042: FAIL: pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a" is not Running: timed out while waiting for pod multivolume-6198/pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.TestConcurrentAccessToRelatedVolumes(0xc000677340, {0x7a4f7c8?, 0xc00372b080}, {0xc003427ac0, 0x10}, {{0xc0041e92a0, 0x1f}, 0x0, 0xc002b62d68}, {0xc00489d980, ...}, ...) test/e2e/storage/testsuites/multivolume.go:696 +0x418 k8s.io/kubernetes/test/e2e/storage/testsuites.(*multiVolumeTestSuite).DefineTests.func8() test/e2e/storage/testsuites/multivolume.go:370 +0x8f3 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f Jun 19 07:34:20.042: INFO: Deleting pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a" in namespace "multivolume-6198" Jun 19 07:34:20.158: INFO: Wait up to 5m0s for pod "pod-d26b6ae4-5a5b-4104-85a3-e1153a966a7a" to be fully deleted Jun 19 07:34:20.240: INFO: Deleting pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7" in namespace "multivolume-6198" Jun 19 07:34:20.345: INFO: Wait up to 5m0s for pod "pod-6f08824e-6d16-46a0-9bef-425c33c922b7" to be fully deleted Jun 19 07:34:22.643: INFO: deleting initClaim "multivolume-6198"/"csi-hostpathtvclh" Jun 19 07:34:22.744: INFO: deleting snapshot "multivolume-6198"/"snapshot-b99kr" Jun 19 07:34:22.781: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d readyToUse:false] Jun 19 07:34:22.781: INFO: snapshotContentName snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d Jun 19 07:34:22.863: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d to be deleted Jun 19 07:34:22.900: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:24.937: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:26.975: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:29.012: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:31.048: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:33.085: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:35.122: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:37.158: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:39.194: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:41.231: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:43.266: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:45.303: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:47.343: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:49.379: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:51.416: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:53.453: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:55.490: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:57.527: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:34:59.564: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:01.601: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:03.637: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:05.674: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:07.710: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:09.746: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:11.784: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:13.821: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:15.859: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:17.896: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:19.933: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:21.970: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:24.007: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:26.052: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:28.089: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:30.127: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:32.168: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:34.205: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:36.244: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:38.280: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:40.317: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:42.354: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:44.392: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:46.429: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:48.466: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:50.503: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:52.542: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:54.588: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:56.625: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:35:58.662: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:00.699: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:02.738: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:04.775: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:06.819: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:08.856: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:10.895: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:12.933: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:14.969: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:17.006: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:19.045: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:21.082: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:23.119: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:25.156: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:27.194: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:29.231: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:31.269: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:33.306: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:35.344: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:37.381: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:39.416: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:41.452: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:43.522: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:45.559: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:47.605: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:49.645: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:51.682: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:53.719: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:55.757: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:57.800: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:36:59.836: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:01.872: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:03.909: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:05.944: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:07.982: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:10.080: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:12.116: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:14.153: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:16.191: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:18.227: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:20.264: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:22.301: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:24.338: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:26.375: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:28.417: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:30.454: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d has been found and is not deleted Jun 19 07:37:32.494: INFO: volumesnapshotcontents snapcontent-5ec852dd-52c6-4fe6-bfdc-e7acb361321d is not found and has been deleted Jun 19 07:37:32.495: INFO: WaitUntil finished successfully after 3m9.631114357s Jun 19 07:37:32.495: INFO: deleting snapshot class "multivolume-61989mfm9" Jun 19 07:37:32.534: INFO: Waiting up to 5m0s for volumesnapshotclasses multivolume-61989mfm9 to be deleted Jun 19 07:37:32.570: INFO: volumesnapshotclasses multivolume-61989mfm9 is not found and has been deleted Jun 19 07:37:32.570: INFO: WaitUntil finished successfully after 36.209215ms �[1mSTEP�[0m: Deleting pvc Jun 19 07:37:32.570: INFO: Deleting PersistentVolumeClaim "csi-hostpathtvclh" Jun 19 07:37:32.642: INFO: Waiting up to 5m0s for PersistentVolume pvc-7b92f2e1-3a37-4e9f-a62b-b0040ca49fb3 to get deleted Jun 19 07:37:32.742: INFO: PersistentVolume pvc-7b92f2e1-3a37-4e9f-a62b-b0040ca49fb3 was removed �[1mSTEP�[0m: Deleting sc �[1mSTEP�[0m: deleting the test namespace: multivolume-6198 �[1mSTEP�[0m: Waiting for namespaces [multivolume-6198] to vanish �[1mSTEP�[0m: uninstalling csi csi-hostpath driver Jun 19 07:37:39.041: INFO: deleting *v1.ServiceAccount: multivolume-6198-7187/csi-attacher Jun 19 07:37:39.146: INFO: deleting *v1.ClusterRole: external-attacher-runner-multivolume-6198 Jun 19 07:37:39.244: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-multivolume-6198 Jun 19 07:37:39.344: INFO: deleting *v1.Role: multivolume-6198-7187/external-attacher-cfg-multivolume-6198 Jun 19 07:37:39.443: INFO: deleting *v1.RoleBinding: multivolume-6198-7187/csi-attacher-role-cfg Jun 19 07:37:39.542: INFO: deleting *v1.ServiceAccount: multivolume-6198-7187/csi-provisioner Jun 19 07:37:39.643: INFO: deleting *v1.ClusterRole: external-provisioner-runner-multivolume-6198 Jun 19 07:37:39.744: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-multivolume-6198 Jun 19 07:37:39.844: INFO: deleting *v1.Role: multivolume-6198-7187/external-provisioner-cfg-multivolume-6198 Jun 19 07:37:39.943: INFO: deleting *v1.RoleBinding: multivolume-6198-7187/csi-provisioner-role-cfg Jun 19 07:37:40.049: INFO: deleting *v1.ServiceAccount: multivolume-6198-7187/csi-snapshotter Jun 19 07:37:40.143: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-multivolume-6198 Jun 19 07:37:40.243: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-multivolume-6198 Jun 19 07:37:40.343: INFO: deleting *v1.Role: multivolume-6198-7187/external-snapshotter-leaderelection-multivolume-6198 Jun 19 07:37:40.443: INFO: deleting *v1.RoleBinding: multivolume-6198-7187/external-snapshotter-leaderelection Jun 19 07:37:40.542: INFO: deleting *v1.ServiceAccount: multivolume-6198-7187/csi-external-health-monitor-controller Jun 19 07:37:40.643: INFO: deleting *v1.ClusterRole: external-health-monitor-controller-runner-multivolume-6198 Jun 19 07:37:40.743: INFO: deleting *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-multivolume-6198 Jun 19 07:37:40.843: INFO: deleting *v1.Role: multivolume-6198-7187/external-health-monitor-controller-cfg-multivolume-6198 Jun 19 07:37:40.943: INFO: deleting *v1.RoleBinding: multivolume-6198-7187/csi-external-health-monitor-controller-role-cfg Jun 19 07:37:41.044: INFO: deleting *v1.ServiceAccount: multivolume-6198-7187/csi-resizer Jun 19 07:37:41.144: INFO: deleting *v1.ClusterRole: external-resizer-runner-multivolume-6198 Jun 19 07:37:41.243: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-multivolume-6198 Jun 19 07:37:41.343: INFO: deleting *v1.Role: multivolume-6198-7187/external-resizer-cfg-multivolume-6198 Jun 19 07:37:41.444: INFO: deleting *v1.RoleBinding: multivolume-6198-7187/csi-resizer-role-cfg Jun 19 07:37:41.543: INFO: deleting *v1.CSIDriver: csi-hostpath-multivolume-6198 Jun 19 07:37:41.645: INFO: deleting *v1.ServiceAccount: multivolume-6198-7187/csi-hostpathplugin-sa Jun 19 07:37:41.743: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-multivolume-6198 Jun 19 07:37:41.842: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-multivolume-6198 Jun 19 07:37:41.944: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-multivolume-6198 Jun 19 07:37:42.043: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-multivolume-6198 Jun 19 07:37:42.143: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-multivolume-6198 Jun 19 07:37:42.243: INFO: deleting *v1.RoleBinding: multivolume-6198-7187/csi-hostpathplugin-attacher-role Jun 19 07:37:42.344: INFO: deleting *v1.RoleBinding: multivolume-6198-7187/csi-hostpathplugin-health-monitor-controller-role Jun 19 07:37:42.443: INFO: deleting *v1.RoleBinding: multivolume-6198-7187/csi-hostpathplugin-provisioner-role Jun 19 07:37:42.543: INFO: deleting *v1.RoleBinding: multivolume-6198-7187/csi-hostpathplugin-resizer-role Jun 19 07:37:42.643: INFO: deleting *v1.RoleBinding: multivolume-6198-7187/csi-hostpathplugin-snapshotter-role Jun 19 07:37:42.743: INFO: deleting *v1.StatefulSet: multivolume-6198-7187/csi-hostpathplugin Jun 19 07:37:42.845: INFO: deleting *v1.ClusterRoleBinding: psp-csi-hostpath-role-multivolume-6198 �[1mSTEP�[0m: deleting the driver namespace: multivolume-6198-7187 �[1mSTEP�[0m: Waiting for namespaces [multivolume-6198-7187] to vanish [AfterEach] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] test/e2e/framework/framework.go:187 Jun 19 07:37:49.084: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\scsi\-hostpath\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sprovisioning\sshould\sprovision\sstorage\swith\ssnapshot\sdata\ssource\s\[Feature\:VolumeSnapshotDataSource\]$'
test/e2e/storage/testsuites/provisioning.go:208 Jun 19 06:53:04.456: VolumeSnapshot snapshot-rdwm9 is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 19 06:47:40.684: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource] test/e2e/storage/testsuites/provisioning.go:208 �[1mSTEP�[0m: Building a driver namespace object, basename provisioning-3900 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi-hostpath driver Jun 19 06:47:41.255: INFO: creating *v1.ServiceAccount: provisioning-3900-9417/csi-attacher Jun 19 06:47:41.291: INFO: creating *v1.ClusterRole: external-attacher-runner-provisioning-3900 Jun 19 06:47:41.291: INFO: Define cluster role external-attacher-runner-provisioning-3900 Jun 19 06:47:41.328: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-provisioning-3900 Jun 19 06:47:41.364: INFO: creating *v1.Role: provisioning-3900-9417/external-attacher-cfg-provisioning-3900 Jun 19 06:47:41.400: INFO: creating *v1.RoleBinding: provisioning-3900-9417/csi-attacher-role-cfg Jun 19 06:47:41.437: INFO: creating *v1.ServiceAccount: provisioning-3900-9417/csi-provisioner Jun 19 06:47:41.473: INFO: creating *v1.ClusterRole: external-provisioner-runner-provisioning-3900 Jun 19 06:47:41.473: INFO: Define cluster role external-provisioner-runner-provisioning-3900 Jun 19 06:47:41.509: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-provisioning-3900 Jun 19 06:47:41.545: INFO: creating *v1.Role: provisioning-3900-9417/external-provisioner-cfg-provisioning-3900 Jun 19 06:47:41.581: INFO: creating *v1.RoleBinding: provisioning-3900-9417/csi-provisioner-role-cfg Jun 19 06:47:41.617: INFO: creating *v1.ServiceAccount: provisioning-3900-9417/csi-snapshotter Jun 19 06:47:41.655: INFO: creating *v1.ClusterRole: external-snapshotter-runner-provisioning-3900 Jun 19 06:47:41.655: INFO: Define cluster role external-snapshotter-runner-provisioning-3900 Jun 19 06:47:41.691: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-provisioning-3900 Jun 19 06:47:41.727: INFO: creating *v1.Role: provisioning-3900-9417/external-snapshotter-leaderelection-provisioning-3900 Jun 19 06:47:41.765: INFO: creating *v1.RoleBinding: provisioning-3900-9417/external-snapshotter-leaderelection Jun 19 06:47:41.805: INFO: creating *v1.ServiceAccount: provisioning-3900-9417/csi-external-health-monitor-controller Jun 19 06:47:41.846: INFO: creating *v1.ClusterRole: external-health-monitor-controller-runner-provisioning-3900 Jun 19 06:47:41.846: INFO: Define cluster role external-health-monitor-controller-runner-provisioning-3900 Jun 19 06:47:41.884: INFO: creating *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-provisioning-3900 Jun 19 06:47:41.920: INFO: creating *v1.Role: provisioning-3900-9417/external-health-monitor-controller-cfg-provisioning-3900 Jun 19 06:47:41.957: INFO: creating *v1.RoleBinding: provisioning-3900-9417/csi-external-health-monitor-controller-role-cfg Jun 19 06:47:41.994: INFO: creating *v1.ServiceAccount: provisioning-3900-9417/csi-resizer Jun 19 06:47:42.031: INFO: creating *v1.ClusterRole: external-resizer-runner-provisioning-3900 Jun 19 06:47:42.031: INFO: Define cluster role external-resizer-runner-provisioning-3900 Jun 19 06:47:42.068: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-provisioning-3900 Jun 19 06:47:42.106: INFO: creating *v1.Role: provisioning-3900-9417/external-resizer-cfg-provisioning-3900 Jun 19 06:47:42.144: INFO: creating *v1.RoleBinding: provisioning-3900-9417/csi-resizer-role-cfg Jun 19 06:47:42.181: INFO: creating *v1.CSIDriver: csi-hostpath-provisioning-3900 Jun 19 06:47:42.218: INFO: creating *v1.ServiceAccount: provisioning-3900-9417/csi-hostpathplugin-sa Jun 19 06:47:42.254: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-provisioning-3900 Jun 19 06:47:42.353: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-provisioning-3900 Jun 19 06:47:42.402: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-provisioning-3900 Jun 19 06:47:42.439: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-provisioning-3900 Jun 19 06:47:42.475: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-provisioning-3900 Jun 19 06:47:42.512: INFO: creating *v1.RoleBinding: provisioning-3900-9417/csi-hostpathplugin-attacher-role Jun 19 06:47:42.548: INFO: creating *v1.RoleBinding: provisioning-3900-9417/csi-hostpathplugin-health-monitor-controller-role Jun 19 06:47:42.585: INFO: creating *v1.RoleBinding: provisioning-3900-9417/csi-hostpathplugin-provisioner-role Jun 19 06:47:42.622: INFO: creating *v1.RoleBinding: provisioning-3900-9417/csi-hostpathplugin-resizer-role Jun 19 06:47:42.658: INFO: creating *v1.RoleBinding: provisioning-3900-9417/csi-hostpathplugin-snapshotter-role Jun 19 06:47:42.695: INFO: creating *v1.StatefulSet: provisioning-3900-9417/csi-hostpathplugin Jun 19 06:47:42.739: INFO: creating *v1.ClusterRoleBinding: psp-csi-hostpath-role-provisioning-3900 Jun 19 06:47:42.783: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Jun 19 06:47:42.783: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Jun 19 06:47:42.783: INFO: In creating storage class object and pvc objects for driver - sc: &StorageClass{ObjectMeta:{provisioning-3900cqrtz 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Provisioner:csi-hostpath-provisioning-3900,Parameters:map[string]string{},ReclaimPolicy:nil,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},}, pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-3900 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1048576 0} {<nil>} 1Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-3900cqrtz,VolumeMode:nil,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},}, src-pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-3900 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1048576 0} {<nil>} 1Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-3900cqrtz,VolumeMode:nil,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: Creating a StorageClass �[1mSTEP�[0m: [Initialize dataSource]creating a initClaim �[1mSTEP�[0m: starting hostpath-injector Jun 19 06:47:43.002: INFO: Waiting up to 5m0s for pod "hostpath-injector" in namespace "provisioning-3900" to be "running" Jun 19 06:47:43.038: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 35.951154ms Jun 19 06:47:45.074: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.072589435s Jun 19 06:47:47.076: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.074184242s Jun 19 06:47:49.075: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.073336561s Jun 19 06:47:51.074: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.072475675s Jun 19 06:47:53.074: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 10.072194404s Jun 19 06:47:55.107: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 12.105189638s Jun 19 06:47:57.074: INFO: Pod "hostpath-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 14.072327771s Jun 19 06:47:59.074: INFO: Pod "hostpath-injector": Phase="Running", Reason="", readiness=true. Elapsed: 16.072451163s Jun 19 06:47:59.074: INFO: Pod "hostpath-injector" satisfied condition "running" �[1mSTEP�[0m: Writing text file contents in the container. Jun 19 06:47:59.074: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.127.118.154 --kubeconfig=/workspace/.kube/config --namespace=provisioning-3900 exec hostpath-injector --namespace=provisioning-3900 -- /bin/sh -c echo 'Hello from namespace provisioning-3900' > /opt/0/index.html' Jun 19 06:47:59.540: INFO: stderr: "" Jun 19 06:47:59.540: INFO: stdout: "" �[1mSTEP�[0m: Checking that text file contents are perfect. Jun 19 06:47:59.540: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.127.118.154 --kubeconfig=/workspace/.kube/config --namespace=provisioning-3900 exec hostpath-injector --namespace=provisioning-3900 -- cat /opt/0/index.html' Jun 19 06:48:00.003: INFO: stderr: "" Jun 19 06:48:00.003: INFO: stdout: "Hello from namespace provisioning-3900\n" Jun 19 06:48:00.003: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:provisioning-3900 PodName:hostpath-injector ContainerName:hostpath-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 19 06:48:00.003: INFO: >>> kubeConfig: /workspace/.kube/config Jun 19 06:48:00.004: INFO: ExecWithOptions: Clientset creation Jun 19 06:48:00.004: INFO: ExecWithOptions: execute(POST https://34.127.118.154/api/v1/namespaces/provisioning-3900/pods/hostpath-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=hostpath-injector&container=hostpath-injector&stderr=true&stdout=true) Jun 19 06:48:00.278: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:provisioning-3900 PodName:hostpath-injector ContainerName:hostpath-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 19 06:48:00.278: INFO: >>> kubeConfig: /workspace/.kube/config Jun 19 06:48:00.279: INFO: ExecWithOptions: Clientset creation Jun 19 06:48:00.279: INFO: ExecWithOptions: execute(POST https://34.127.118.154/api/v1/namespaces/provisioning-3900/pods/hostpath-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=hostpath-injector&container=hostpath-injector&stderr=true&stdout=true) �[1mSTEP�[0m: Deleting pod hostpath-injector in namespace provisioning-3900 Jun 19 06:48:00.610: INFO: Waiting for pod hostpath-injector to disappear Jun 19 06:48:00.645: INFO: Pod hostpath-injector still exists Jun 19 06:48:02.645: INFO: Waiting for pod hostpath-injector to disappear Jun 19 06:48:02.686: INFO: Pod hostpath-injector no longer exists �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 19 06:48:02.803: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-rdwm9 to become ready Jun 19 06:48:02.851: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:04.888: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:06.925: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:08.964: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:11.001: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:13.039: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:15.076: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:17.113: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:19.151: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:21.188: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:23.226: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:25.264: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:27.302: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:29.339: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:31.376: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:33.414: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:35.451: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:37.488: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:39.525: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:41.561: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:43.599: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:45.636: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:47.673: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:49.709: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:51.747: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:53.783: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:55.819: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:57.856: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:48:59.893: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:01.930: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:03.967: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:06.004: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:08.043: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:10.080: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:12.119: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:14.156: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:16.192: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:18.230: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:20.266: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:22.304: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:24.342: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:26.380: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:28.418: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:30.455: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:32.493: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:34.530: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:36.568: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:38.606: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:40.643: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:42.680: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:44.717: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:46.755: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:48.797: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:50.833: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:52.870: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:54.907: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:56.944: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:49:58.982: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:01.017: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:03.054: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:05.090: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:07.129: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:09.166: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:11.204: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:13.240: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:15.277: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:17.314: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:19.352: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:21.389: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:23.425: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:25.462: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:27.502: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:29.540: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:31.577: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:33.613: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:35.650: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:37.687: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:39.724: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:41.761: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:43.848: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:45.884: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:47.921: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:49.957: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:51.994: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:54.030: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:56.066: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:50:58.104: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:00.141: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:02.178: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:04.215: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:06.251: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:08.288: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:10.326: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:12.364: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:14.402: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:16.438: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:18.475: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:20.512: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:22.549: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:24.586: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:26.624: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:28.661: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:30.698: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:32.737: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:34.775: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:36.819: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:38.856: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:40.892: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:42.991: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:45.028: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:47.064: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:49.101: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:51.138: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:53.175: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:55.213: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:57.251: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:51:59.288: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:01.325: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:03.362: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:05.398: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:07.438: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:09.475: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:11.513: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:13.550: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:15.587: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:17.626: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:19.663: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:21.699: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:23.738: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:25.774: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:27.817: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:29.854: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:31.890: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:33.927: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:35.965: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:38.002: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:40.039: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:42.076: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:44.112: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:46.150: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:48.187: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:50.224: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:52.262: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:54.306: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:56.343: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:52:58.381: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:53:00.418: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:53:02.455: INFO: VolumeSnapshot snapshot-rdwm9 found but is not ready. Jun 19 06:53:04.455: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 19 06:53:04.455: INFO: Unexpected error: <*errors.errorString | 0xc0035ce4a0>: { s: "VolumeSnapshot snapshot-rdwm9 is not ready within 5m0s", } Jun 19 06:53:04.456: FAIL: VolumeSnapshot snapshot-rdwm9 is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc0004a4d78?}, 0xc0037f5418) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f9d66eec7d8, 0xc0010b5c00}, 0xc0048bc6c0, {{0x7182fb1, 0x17}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage/testsuites.prepareSnapshotDataSourceForProvisioning(_, {{0xc0041568b8, 0x11}, {0x713b04a, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...) test/e2e/storage/testsuites/provisioning.go:1090 +0x41f k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() test/e2e/storage/testsuites/provisioning.go:227 +0x485 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: creating claim=&PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-3900 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1048576 0} {<nil>} 1Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-3900cqrtz,VolumeMode:nil,DataSource:&TypedLocalObjectReference{APIGroup:*snapshot.storage.k8s.io,Kind:VolumeSnapshot,Name:snapshot-rdwm9,},DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: checking whether the created volume has the pre-populated data �[1mSTEP�[0m: starting hostpath-client Jun 19 06:53:04.581: INFO: Waiting up to 15m0s for pod "hostpath-client" in namespace "provisioning-3900" to be "running" Jun 19 06:53:04.616: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 34.883198ms Jun 19 06:53:06.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071464958s Jun 19 06:53:08.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4.072238121s Jun 19 06:53:10.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6.071598967s Jun 19 06:53:12.656: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8.074420562s Jun 19 06:53:14.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10.071693638s Jun 19 06:53:16.664: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12.082535165s Jun 19 06:53:18.652: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14.070550417s Jun 19 06:53:20.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 16.071441778s Jun 19 06:53:22.652: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 18.070803057s Jun 19 06:53:24.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 20.071424095s Jun 19 06:53:26.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 22.071784642s Jun 19 06:53:28.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 24.072209615s Jun 19 06:53:30.652: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 26.07121047s Jun 19 06:53:32.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 28.072073585s Jun 19 06:53:34.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 30.072271275s Jun 19 06:53:36.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 32.07166543s Jun 19 06:53:38.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 34.07147842s Jun 19 06:53:40.652: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 36.071127907s Jun 19 06:53:42.654: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 38.072892508s Jun 19 06:53:44.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 40.072020228s Jun 19 06:53:46.654: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 42.072436092s Jun 19 06:53:48.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 44.071633262s Jun 19 06:53:50.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 46.072212658s Jun 19 06:53:52.652: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 48.071002236s Jun 19 06:53:54.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 50.071383729s Jun 19 06:53:56.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 52.071776253s Jun 19 06:53:58.654: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 54.07316985s Jun 19 06:54:00.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 56.071836413s Jun 19 06:54:02.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 58.071587802s Jun 19 06:54:04.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.071493256s Jun 19 06:54:06.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.071377514s Jun 19 06:54:08.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.072197223s Jun 19 06:54:10.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.07150811s Jun 19 06:54:12.652: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.071088879s Jun 19 06:54:14.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.071446932s Jun 19 06:54:16.652: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.070454063s Jun 19 06:54:18.652: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.070954504s Jun 19 06:54:20.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.072018042s Jun 19 06:54:22.651: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.07016816s Jun 19 06:54:24.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.072227851s Jun 19 06:54:26.670: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.088953457s Jun 19 06:54:28.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.086753207s Jun 19 06:54:30.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.087014443s Jun 19 06:54:32.672: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.091154772s Jun 19 06:54:34.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.08708675s Jun 19 06:54:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.08644236s Jun 19 06:54:38.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.086413115s Jun 19 06:54:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.087024126s Jun 19 06:54:42.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.087441959s Jun 19 06:54:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.086429951s Jun 19 06:54:46.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.086775363s Jun 19 06:54:48.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.087064185s Jun 19 06:54:50.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.087082512s Jun 19 06:54:52.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.087088464s Jun 19 06:54:54.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.086622767s Jun 19 06:54:56.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.087371102s Jun 19 06:54:58.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.086628988s Jun 19 06:55:00.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.086954547s Jun 19 06:55:02.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.086534915s Jun 19 06:55:04.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.087276126s Jun 19 06:55:06.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.087476565s Jun 19 06:55:08.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.086839383s Jun 19 06:55:10.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.087194373s Jun 19 06:55:12.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.08743588s Jun 19 06:55:14.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.087344162s Jun 19 06:55:16.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.087026742s Jun 19 06:55:18.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.087655541s Jun 19 06:55:20.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.087387713s Jun 19 06:55:22.681: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.100317739s Jun 19 06:55:24.702: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.121254305s Jun 19 06:55:26.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.086556722s Jun 19 06:55:28.670: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.089050235s Jun 19 06:55:30.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.086899717s Jun 19 06:55:32.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.08683365s Jun 19 06:55:34.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.086727237s Jun 19 06:55:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.086890311s Jun 19 06:55:38.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.086501794s Jun 19 06:55:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.086909456s Jun 19 06:55:42.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.087265053s Jun 19 06:55:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.086889917s Jun 19 06:55:46.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.08725813s Jun 19 06:55:48.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.087658255s Jun 19 06:55:50.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.086931681s Jun 19 06:55:52.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.087462455s Jun 19 06:55:54.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.086963995s Jun 19 06:55:56.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.087036553s Jun 19 06:55:58.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.086460168s Jun 19 06:56:00.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.086967334s Jun 19 06:56:02.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.086796344s Jun 19 06:56:04.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.088067542s Jun 19 06:56:06.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.086927952s Jun 19 06:56:08.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.087657661s Jun 19 06:56:10.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.087169075s Jun 19 06:56:12.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.086736892s Jun 19 06:56:14.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.087032182s Jun 19 06:56:16.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.085876259s Jun 19 06:56:18.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.086086346s Jun 19 06:56:20.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.087017444s Jun 19 06:56:22.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.0872745s Jun 19 06:56:24.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.087054405s Jun 19 06:56:26.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.087211892s Jun 19 06:56:28.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.087295194s Jun 19 06:56:30.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.086980065s Jun 19 06:56:32.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.086998598s Jun 19 06:56:34.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.087825641s Jun 19 06:56:36.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.08745113s Jun 19 06:56:38.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.086941529s Jun 19 06:56:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.086383449s Jun 19 06:56:42.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.086931089s Jun 19 06:56:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.086621591s Jun 19 06:56:46.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.086729351s Jun 19 06:56:48.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.08676401s Jun 19 06:56:50.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.087527165s Jun 19 06:56:52.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.086974055s Jun 19 06:56:54.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.087239791s Jun 19 06:56:56.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.08673987s Jun 19 06:56:58.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.087394086s Jun 19 06:57:00.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.085967546s Jun 19 06:57:02.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.087183077s Jun 19 06:57:04.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.088153799s Jun 19 06:57:06.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.086446214s Jun 19 06:57:08.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.087429474s Jun 19 06:57:10.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.086834144s Jun 19 06:57:12.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.08707604s Jun 19 06:57:14.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.087358683s Jun 19 06:57:16.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.086861665s Jun 19 06:57:18.675: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.093781568s Jun 19 06:57:20.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.085713457s Jun 19 06:57:22.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.086491834s Jun 19 06:57:24.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.08776153s Jun 19 06:57:26.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.087162471s Jun 19 06:57:28.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.086855607s Jun 19 06:57:30.672: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.090388426s Jun 19 06:57:32.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.087681061s Jun 19 06:57:34.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.086692431s Jun 19 06:57:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.086558076s Jun 19 06:57:38.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.087209099s Jun 19 06:57:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.086674503s Jun 19 06:57:42.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.087648801s Jun 19 06:57:44.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.087405267s Jun 19 06:57:46.652: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.071288959s Jun 19 06:57:48.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.086811863s Jun 19 06:57:50.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.087017347s Jun 19 06:57:52.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.087105857s Jun 19 06:57:54.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.087421228s Jun 19 06:57:56.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.086081788s Jun 19 06:57:58.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.087229306s Jun 19 06:58:00.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.086531784s Jun 19 06:58:02.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.0865452s Jun 19 06:58:04.670: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.088859628s Jun 19 06:58:06.759: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.177876503s Jun 19 06:58:08.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.087728751s Jun 19 06:58:10.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.086431891s Jun 19 06:58:12.672: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.091308432s Jun 19 06:58:14.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.08700716s Jun 19 06:58:16.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.086803184s Jun 19 06:58:18.673: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.091786757s Jun 19 06:58:20.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.08741906s Jun 19 06:58:22.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.086690081s Jun 19 06:58:24.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.086982184s Jun 19 06:58:26.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.086550527s Jun 19 06:58:28.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.087168906s Jun 19 06:58:30.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.088219573s Jun 19 06:58:32.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.086681337s Jun 19 06:58:34.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.086788425s Jun 19 06:58:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.086742576s Jun 19 06:58:38.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m34.086908138s Jun 19 06:58:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m36.086437926s Jun 19 06:58:42.676: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m38.094536932s Jun 19 06:58:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m40.087166966s Jun 19 06:58:46.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m42.087212458s Jun 19 06:58:48.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m44.086977856s Jun 19 06:58:50.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m46.086783571s Jun 19 06:58:52.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m48.086728347s Jun 19 06:58:54.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.087087797s Jun 19 06:58:56.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.086696134s Jun 19 06:58:58.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.086381853s Jun 19 06:59:00.670: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.088549646s Jun 19 06:59:02.682: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.101160198s Jun 19 06:59:04.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.087486545s Jun 19 06:59:06.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.086693337s Jun 19 06:59:08.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.086086846s Jun 19 06:59:10.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.08711958s Jun 19 06:59:12.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.087481084s Jun 19 06:59:14.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.085859711s Jun 19 06:59:16.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.086520432s Jun 19 06:59:18.671: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.090198803s Jun 19 06:59:20.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.086858953s Jun 19 06:59:22.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.086794604s Jun 19 06:59:24.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.087433599s Jun 19 06:59:26.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.087222253s Jun 19 06:59:28.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.086635714s Jun 19 06:59:30.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.086697915s Jun 19 06:59:32.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.08683401s Jun 19 06:59:34.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.086120878s Jun 19 06:59:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.086884144s Jun 19 06:59:38.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.086125627s Jun 19 06:59:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.087207907s Jun 19 06:59:42.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.087073835s Jun 19 06:59:44.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.087538952s Jun 19 06:59:46.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.086718805s Jun 19 06:59:48.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m44.087079221s Jun 19 06:59:50.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m46.086297671s Jun 19 06:59:52.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m48.086846562s Jun 19 06:59:54.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m50.086545532s Jun 19 06:59:56.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m52.087226024s Jun 19 06:59:58.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.086745795s Jun 19 07:00:00.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.087065174s Jun 19 07:00:02.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.087592815s Jun 19 07:00:04.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.086553341s Jun 19 07:00:06.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.087675702s Jun 19 07:00:08.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.086972942s Jun 19 07:00:10.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.08687334s Jun 19 07:00:12.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.087061957s Jun 19 07:00:14.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.086335764s Jun 19 07:00:16.676: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.095102004s Jun 19 07:00:18.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.086981865s Jun 19 07:00:20.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m16.0869883s Jun 19 07:00:22.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m18.072063892s Jun 19 07:00:24.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m20.087085442s Jun 19 07:00:26.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m22.086571815s Jun 19 07:00:28.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m24.086746313s Jun 19 07:00:30.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m26.086960616s Jun 19 07:00:32.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m28.08767474s Jun 19 07:00:34.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m30.085964019s Jun 19 07:00:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m32.087020796s Jun 19 07:00:38.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m34.086668107s Jun 19 07:00:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m36.086994554s Jun 19 07:00:42.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m38.086510331s Jun 19 07:00:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m40.087035755s Jun 19 07:00:46.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m42.086396295s Jun 19 07:00:48.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m44.087023815s Jun 19 07:00:50.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m46.08703663s Jun 19 07:00:52.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.087772026s Jun 19 07:00:54.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.086545676s Jun 19 07:00:56.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.086545471s Jun 19 07:00:58.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.087283668s Jun 19 07:01:00.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.086867213s Jun 19 07:01:02.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.0878224s Jun 19 07:01:04.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.086616075s Jun 19 07:01:06.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m2.087124893s Jun 19 07:01:08.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m4.087124705s Jun 19 07:01:10.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m6.087033188s Jun 19 07:01:12.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m8.086605007s Jun 19 07:01:14.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m10.086746412s Jun 19 07:01:16.670: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m12.08850802s Jun 19 07:01:18.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m14.087155935s Jun 19 07:01:20.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m16.086769491s Jun 19 07:01:22.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m18.08719252s Jun 19 07:01:24.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m20.086119974s Jun 19 07:01:26.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m22.086643198s Jun 19 07:01:28.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m24.086882821s Jun 19 07:01:30.653: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m26.072194554s Jun 19 07:01:32.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m28.08658605s Jun 19 07:01:34.679: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m30.097920058s Jun 19 07:01:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.086723952s Jun 19 07:01:38.651: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.06970469s Jun 19 07:01:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.086804155s Jun 19 07:01:42.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.086824637s Jun 19 07:01:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.086359726s Jun 19 07:01:46.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.087231464s Jun 19 07:01:48.713: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.13158991s Jun 19 07:01:50.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m46.087242593s Jun 19 07:01:52.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m48.087483532s Jun 19 07:01:54.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m50.087630594s Jun 19 07:01:56.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m52.086707674s Jun 19 07:01:58.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m54.087248859s Jun 19 07:02:00.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m56.087099804s Jun 19 07:02:02.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8m58.087091202s Jun 19 07:02:04.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m0.086448483s Jun 19 07:02:06.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m2.086876586s Jun 19 07:02:08.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m4.086796348s Jun 19 07:02:10.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m6.086943279s Jun 19 07:02:12.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m8.08640036s Jun 19 07:02:14.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m10.086075323s Jun 19 07:02:16.673: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m12.091864707s Jun 19 07:02:18.670: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m14.088648194s Jun 19 07:02:20.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m16.086740038s Jun 19 07:02:22.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m18.086981811s Jun 19 07:02:24.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m20.086887824s Jun 19 07:02:26.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m22.086172666s Jun 19 07:02:28.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m24.0867687s Jun 19 07:02:30.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m26.087501751s Jun 19 07:02:32.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m28.08741636s Jun 19 07:02:34.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m30.087053221s Jun 19 07:02:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m32.086764947s Jun 19 07:02:38.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m34.087106075s Jun 19 07:02:40.670: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m36.089231249s Jun 19 07:02:42.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m38.087287704s Jun 19 07:02:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m40.08703788s Jun 19 07:02:46.671: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m42.090314588s Jun 19 07:02:48.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m44.086032916s Jun 19 07:02:50.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m46.086815723s Jun 19 07:02:52.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m48.086820409s Jun 19 07:02:54.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m50.08739735s Jun 19 07:02:56.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m52.087265027s Jun 19 07:02:58.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m54.086225675s Jun 19 07:03:00.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m56.087165858s Jun 19 07:03:02.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 9m58.087871069s Jun 19 07:03:04.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m0.087146608s Jun 19 07:03:06.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m2.087242258s Jun 19 07:03:08.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m4.087248624s Jun 19 07:03:10.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m6.087128052s Jun 19 07:03:12.652: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m8.070596001s Jun 19 07:03:14.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m10.087609385s Jun 19 07:03:16.671: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m12.089819034s Jun 19 07:03:18.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m14.088128129s Jun 19 07:03:20.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m16.086694313s Jun 19 07:03:22.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m18.0861479s Jun 19 07:03:24.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m20.086680454s Jun 19 07:03:26.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m22.086572005s Jun 19 07:03:28.691: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m24.109902288s Jun 19 07:03:30.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m26.08697207s Jun 19 07:03:32.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m28.087440753s Jun 19 07:03:34.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m30.086960244s Jun 19 07:03:36.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m32.086301056s Jun 19 07:03:38.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m34.086723228s Jun 19 07:03:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m36.087053533s Jun 19 07:03:42.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m38.087041357s Jun 19 07:03:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m40.086344738s Jun 19 07:03:46.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m42.087528512s Jun 19 07:03:48.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m44.086772442s Jun 19 07:03:50.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m46.086973631s Jun 19 07:03:52.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m48.087497799s Jun 19 07:03:54.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m50.087067431s Jun 19 07:03:56.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m52.087651916s Jun 19 07:03:58.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m54.086671134s Jun 19 07:04:00.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m56.088247524s Jun 19 07:04:02.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10m58.08636055s Jun 19 07:04:04.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m0.087213942s Jun 19 07:04:06.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m2.087389513s Jun 19 07:04:08.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m4.086824047s Jun 19 07:04:10.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m6.086762663s Jun 19 07:04:12.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m8.086446643s Jun 19 07:04:14.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m10.086177284s Jun 19 07:04:16.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m12.086874856s Jun 19 07:04:18.679: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m14.098056443s Jun 19 07:04:20.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m16.086626219s Jun 19 07:04:22.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m18.08649927s Jun 19 07:04:24.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m20.086346966s Jun 19 07:04:26.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m22.087144045s Jun 19 07:04:28.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m24.086695359s Jun 19 07:04:30.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m26.087475858s Jun 19 07:04:32.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m28.087540249s Jun 19 07:04:34.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m30.087240121s Jun 19 07:04:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m32.087085222s Jun 19 07:04:38.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m34.087452609s Jun 19 07:04:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m36.086482233s Jun 19 07:04:42.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m38.086912147s Jun 19 07:04:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m40.086984035s Jun 19 07:04:46.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m42.087322014s Jun 19 07:04:48.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m44.087101291s Jun 19 07:04:50.672: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m46.090771471s Jun 19 07:04:52.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m48.085989202s Jun 19 07:04:54.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m50.086671409s Jun 19 07:04:56.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m52.086209963s Jun 19 07:04:58.671: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m54.090191675s Jun 19 07:05:00.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m56.086667146s Jun 19 07:05:02.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 11m58.087207876s Jun 19 07:05:04.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m0.087941788s Jun 19 07:05:06.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m2.087030413s Jun 19 07:05:08.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m4.087952771s Jun 19 07:05:10.673: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m6.09209227s Jun 19 07:05:12.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m8.087303589s Jun 19 07:05:14.670: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m10.088413206s Jun 19 07:05:16.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m12.087228626s Jun 19 07:05:18.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m14.087998408s Jun 19 07:05:20.670: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m16.088663167s Jun 19 07:05:22.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m18.086363383s Jun 19 07:05:24.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m20.086996197s Jun 19 07:05:26.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m22.086979961s Jun 19 07:05:28.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m24.087142126s Jun 19 07:05:30.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m26.086820903s Jun 19 07:05:32.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m28.086820132s Jun 19 07:05:34.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m30.086009993s Jun 19 07:05:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m32.086822669s Jun 19 07:05:38.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m34.08689081s Jun 19 07:05:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m36.086968815s Jun 19 07:05:42.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m38.086373601s Jun 19 07:05:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m40.086750799s Jun 19 07:05:46.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m42.086647248s Jun 19 07:05:48.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m44.086764571s Jun 19 07:05:50.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m46.086727315s Jun 19 07:05:52.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m48.087161772s Jun 19 07:05:54.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m50.086531669s Jun 19 07:05:56.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m52.086893568s Jun 19 07:05:58.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m54.087244682s Jun 19 07:06:00.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m56.086633426s Jun 19 07:06:02.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12m58.087565746s Jun 19 07:06:04.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m0.086741301s Jun 19 07:06:06.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m2.087135271s Jun 19 07:06:08.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m4.087625126s Jun 19 07:06:10.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m6.087470907s Jun 19 07:06:12.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m8.087355915s Jun 19 07:06:14.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m10.086661518s Jun 19 07:06:16.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m12.086894505s Jun 19 07:06:18.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m14.086857599s Jun 19 07:06:20.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m16.086400512s Jun 19 07:06:22.671: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m18.089350782s Jun 19 07:06:24.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m20.087235982s Jun 19 07:06:26.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m22.08614517s Jun 19 07:06:28.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m24.086638906s Jun 19 07:06:30.652: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m26.070637614s Jun 19 07:06:32.683: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m28.101326887s Jun 19 07:06:34.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m30.087002182s Jun 19 07:06:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m32.086927775s Jun 19 07:06:38.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m34.086718815s Jun 19 07:06:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m36.08714603s Jun 19 07:06:42.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m38.086925724s Jun 19 07:06:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m40.086906286s Jun 19 07:06:46.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m42.087186646s Jun 19 07:06:48.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m44.087180468s Jun 19 07:06:50.755: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m46.174258017s Jun 19 07:06:52.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m48.086875324s Jun 19 07:06:54.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m50.086434966s Jun 19 07:06:56.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m52.086807988s Jun 19 07:06:58.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m54.086889387s Jun 19 07:07:00.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m56.086716774s Jun 19 07:07:02.675: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 13m58.093904528s Jun 19 07:07:04.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m0.087421778s Jun 19 07:07:06.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m2.08691508s Jun 19 07:07:08.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m4.087290955s Jun 19 07:07:10.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m6.086797407s Jun 19 07:07:12.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m8.08762209s Jun 19 07:07:14.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m10.087104365s Jun 19 07:07:16.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m12.087518854s Jun 19 07:07:18.672: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m14.090938581s Jun 19 07:07:20.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m16.08645234s Jun 19 07:07:22.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m18.086272433s Jun 19 07:07:24.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m20.086678994s Jun 19 07:07:26.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m22.086346331s Jun 19 07:07:28.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m24.086195076s Jun 19 07:07:30.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m26.087706579s Jun 19 07:07:32.674: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m28.093075256s Jun 19 07:07:34.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m30.086813804s Jun 19 07:07:36.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m32.086842479s Jun 19 07:07:38.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m34.086453557s Jun 19 07:07:40.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m36.087096491s Jun 19 07:07:42.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m38.087088753s Jun 19 07:07:44.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m40.087178746s Jun 19 07:07:46.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m42.086733319s Jun 19 07:07:48.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m44.086759968s Jun 19 07:07:50.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m46.086114668s Jun 19 07:07:52.667: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m48.085962009s Jun 19 07:07:54.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m50.087353003s Jun 19 07:07:56.669: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m52.087718375s Jun 19 07:07:58.671: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m54.089694578s Jun 19 07:08:00.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m56.086834304s Jun 19 07:08:02.673: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14m58.092016758s Jun 19 07:08:04.668: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.086445741s Jun 19 07:08:04.768: INFO: Pod "hostpath-client": Phase="Pending", Reason="", readiness=false. Elapsed: 15m0.186585338s �[1mSTEP�[0m: Deleting pod hostpath-client in namespace provisioning-3900 Jun 19 07:08:04.885: INFO: Waiting for pod hostpath-client to disappear Jun 19 07:08:04.968: INFO: Pod hostpath-client no longer exists Jun 19 07:08:04.969: FAIL: Failed to create client pod: timed out while waiting for pod provisioning-3900/hostpath-client to be running Full Stack Trace k8s.io/kubernetes/test/e2e/framework/volume.TestVolumeClientSlow(...) test/e2e/framework/volume/fixtures.go:589 k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4.1(0xc002ab4000) test/e2e/storage/testsuites/provisioning.go:241 +0x269 k8s.io/kubernetes/test/e2e/storage/testsuites.StorageClassTest.TestDynamicProvisioning({{0x7a4f7c8, 0xc002430d80}, 0xc000f55900, 0xc002496c40, 0xc002496e00, 0xc004428600, {0x0, 0x0}, {0x0, 0x0, ...}, ...}) test/e2e/storage/testsuites/provisioning.go:637 +0x87a k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() test/e2e/storage/testsuites/provisioning.go:243 +0x618 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f Jun 19 07:08:04.969: INFO: deleting claim "provisioning-3900"/"pvc-dg9kz" Jun 19 07:08:05.076: INFO: deleting initClaim "provisioning-3900"/"pvc-wmhxl" Jun 19 07:08:05.170: INFO: deleting snapshot "provisioning-3900"/"snapshot-rdwm9" Jun 19 07:08:05.206: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b readyToUse:false] Jun 19 07:08:05.206: INFO: snapshotContentName snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b Jun 19 07:08:05.282: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b to be deleted Jun 19 07:08:05.319: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:07.356: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:09.393: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:11.429: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:13.466: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:15.504: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:17.539: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:19.576: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:21.613: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:23.649: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:25.686: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:27.724: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:29.761: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:31.801: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:33.838: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:35.875: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:37.912: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:39.949: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:41.986: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:44.023: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:46.060: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:48.097: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:50.133: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:52.171: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:54.208: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:56.246: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:08:58.283: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:00.321: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:02.357: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:04.394: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:06.431: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:08.469: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:10.506: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:12.543: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:14.580: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:16.616: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:18.653: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:20.690: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:22.726: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:24.763: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:26.800: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:28.836: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:30.873: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:32.912: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:34.949: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:36.985: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:39.022: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:41.059: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:43.096: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:45.132: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:47.171: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:49.207: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:51.243: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:53.280: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:55.317: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:57.355: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:09:59.392: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:01.429: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:03.466: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:05.503: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:07.539: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:09.576: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:11.614: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:13.650: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:15.687: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:17.728: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:19.765: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:21.803: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:23.840: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:25.876: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:27.916: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:29.953: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:31.989: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:34.026: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:36.063: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:38.188: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:40.224: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:42.275: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:44.312: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:46.349: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:48.402: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:50.445: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:52.482: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:54.524: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:56.561: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:10:58.615: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:00.653: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:02.689: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:04.727: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:06.764: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:08.801: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:10.837: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:12.874: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:14.911: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:16.948: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:18.985: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:21.021: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:23.058: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:25.094: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:27.131: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:29.175: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:31.211: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b has been found and is not deleted Jun 19 07:11:33.248: INFO: volumesnapshotcontents snapcontent-cbd22193-024d-41cf-987c-75e473c58f1b is not found and has been deleted Jun 19 07:11:33.249: INFO: WaitUntil finished successfully after 3m27.966419757s Jun 19 07:11:33.249: INFO: deleting snapshot class "provisioning-3900fgzmn" Jun 19 07:11:33.287: INFO: Waiting up to 5m0s for volumesnapshotclasses provisioning-3900fgzmn to be deleted Jun 19 07:11:33.322: INFO: volumesnapshotclasses provisioning-3900fgzmn is not found and has been deleted Jun 19 07:11:33.322: INFO: WaitUntil finished successfully after 34.5858ms Jun 19 07:11:33.322: INFO: deleting storage class provisioning-3900cqrtz �[1mSTEP�[0m: deleting the test namespace: provisioning-3900 �[1mSTEP�[0m: Waiting for namespaces [provisioning-3900] to vanish �[1mSTEP�[0m: uninstalling csi csi-hostpath driver Jun 19 07:11:39.569: INFO: deleting *v1.ServiceAccount: provisioning-3900-9417/csi-attacher Jun 19 07:11:39.670: INFO: deleting *v1.ClusterRole: external-attacher-runner-provisioning-3900 Jun 19 07:11:39.772: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-provisioning-3900 Jun 19 07:11:39.869: INFO: deleting *v1.Role: provisioning-3900-9417/external-attacher-cfg-provisioning-3900 Jun 19 07:11:39.969: INFO: deleting *v1.RoleBinding: provisioning-3900-9417/csi-attacher-role-cfg Jun 19 07:11:40.071: INFO: deleting *v1.ServiceAccount: provisioning-3900-9417/csi-provisioner Jun 19 07:11:40.172: INFO: deleting *v1.ClusterRole: external-provisioner-runner-provisioning-3900 Jun 19 07:11:40.271: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-provisioning-3900 Jun 19 07:11:40.370: INFO: deleting *v1.Role: provisioning-3900-9417/external-provisioner-cfg-provisioning-3900 Jun 19 07:11:40.470: INFO: deleting *v1.RoleBinding: provisioning-3900-9417/csi-provisioner-role-cfg Jun 19 07:11:40.571: INFO: deleting *v1.ServiceAccount: provisioning-3900-9417/csi-snapshotter Jun 19 07:11:40.670: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-provisioning-3900 Jun 19 07:11:40.773: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-provisioning-3900 Jun 19 07:11:40.871: INFO: deleting *v1.Role: provisioning-3900-9417/external-snapshotter-leaderelection-provisioning-3900 Jun 19 07:11:40.970: INFO: deleting *v1.RoleBinding: provisioning-3900-9417/external-snapshotter-leaderelection Jun 19 07:11:41.069: INFO: deleting *v1.ServiceAccount: provisioning-3900-9417/csi-external-health-monitor-controller Jun 19 07:11:41.170: INFO: deleting *v1.ClusterRole: external-health-monitor-controller-runner-provisioning-3900 Jun 19 07:11:41.269: INFO: deleting *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-provisioning-3900 Jun 19 07:11:41.370: INFO: deleting *v1.Role: provisioning-3900-9417/external-health-monitor-controller-cfg-provisioning-3900 Jun 19 07:11:41.469: INFO: deleting *v1.RoleBinding: provisioning-3900-9417/csi-external-health-monitor-controller-role-cfg Jun 19 07:11:41.569: INFO: deleting *v1.ServiceAccount: provisioning-3900-9417/csi-resizer Jun 19 07:11:41.670: INFO: deleting *v1.ClusterRole: external-resizer-runner-provisioning-3900 Jun 19 07:11:41.771: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-provisioning-3900 Jun 19 07:11:41.870: INFO: deleting *v1.Role: provisioning-3900-9417/external-resizer-cfg-provisioning-3900 Jun 19 07:11:42.008: INFO: deleting *v1.RoleBinding: provisioning-3900-9417/csi-resizer-role-cfg Jun 19 07:11:42.070: INFO: deleting *v1.CSIDriver: csi-hostpath-provisioning-3900 Jun 19 07:11:42.170: INFO: deleting *v1.ServiceAccount: provisioning-3900-9417/csi-hostpathplugin-sa Jun 19 07:11:42.271: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-provisioning-3900 Jun 19 07:11:42.370: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-provisioning-3900 Jun 19 07:11:42.472: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-provisioning-3900 Jun 19 07:11:42.570: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-provisioning-3900 Jun 19 07:11:42.669: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-provisioning-3900 Jun 19 07:11:42.839: INFO: deleting *v1.RoleBinding: provisioning-3900-9417/csi-hostpathplugin-attacher-role Jun 19 07:11:42.879: INFO: deleting *v1.RoleBinding: provisioning-3900-9417/csi-hostpathplugin-health-monitor-controller-role Jun 19 07:11:42.970: INFO: deleting *v1.RoleBinding: provisioning-3900-9417/csi-hostpathplugin-provisioner-role Jun 19 07:11:43.073: INFO: deleting *v1.RoleBinding: provisioning-3900-9417/csi-hostpathplugin-resizer-role Jun 19 07:11:43.170: INFO: deleting *v1.RoleBinding: provisioning-3900-9417/csi-hostpathplugin-snapshotter-role Jun 19 07:11:43.270: INFO: deleting *v1.StatefulSet: provisioning-3900-9417/csi-hostpathplugin Jun 19 07:11:43.373: INFO: deleting *v1.ClusterRoleBinding: psp-csi-hostpath-role-provisioning-3900 �[1mSTEP�[0m: deleting the driver namespace: provisioning-3900-9417 �[1mSTEP�[0m: Waiting for namespaces [provisioning-3900-9417] to vanish [AfterEach] [Testpattern: Dynamic PV (default fs)] provisioning test/e2e/framework/framework.go:187 Jun 19 07:11:49.638: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\scsi\-hostpath\]\s\[Testpattern\:\sPre\-provisioned\sSnapshot\s\(delete\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion\s\(persistent\)$'
test/e2e/storage/testsuites/snapshottable.go:278 Jun 19 07:17:10.350: VolumeSnapshot snapshot-76cfz is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 19 07:11:49.676: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent) test/e2e/storage/testsuites/snapshottable.go:278 �[1mSTEP�[0m: Building a driver namespace object, basename snapshotting-7770 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi-hostpath driver Jun 19 07:11:50.252: INFO: creating *v1.ServiceAccount: snapshotting-7770-4310/csi-attacher Jun 19 07:11:50.289: INFO: creating *v1.ClusterRole: external-attacher-runner-snapshotting-7770 Jun 19 07:11:50.289: INFO: Define cluster role external-attacher-runner-snapshotting-7770 Jun 19 07:11:50.326: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-7770 Jun 19 07:11:50.363: INFO: creating *v1.Role: snapshotting-7770-4310/external-attacher-cfg-snapshotting-7770 Jun 19 07:11:50.399: INFO: creating *v1.RoleBinding: snapshotting-7770-4310/csi-attacher-role-cfg Jun 19 07:11:50.435: INFO: creating *v1.ServiceAccount: snapshotting-7770-4310/csi-provisioner Jun 19 07:11:50.471: INFO: creating *v1.ClusterRole: external-provisioner-runner-snapshotting-7770 Jun 19 07:11:50.471: INFO: Define cluster role external-provisioner-runner-snapshotting-7770 Jun 19 07:11:50.510: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-7770 Jun 19 07:11:50.546: INFO: creating *v1.Role: snapshotting-7770-4310/external-provisioner-cfg-snapshotting-7770 Jun 19 07:11:50.582: INFO: creating *v1.RoleBinding: snapshotting-7770-4310/csi-provisioner-role-cfg Jun 19 07:11:50.619: INFO: creating *v1.ServiceAccount: snapshotting-7770-4310/csi-snapshotter Jun 19 07:11:50.655: INFO: creating *v1.ClusterRole: external-snapshotter-runner-snapshotting-7770 Jun 19 07:11:50.655: INFO: Define cluster role external-snapshotter-runner-snapshotting-7770 Jun 19 07:11:50.693: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-snapshotting-7770 Jun 19 07:11:50.729: INFO: creating *v1.Role: snapshotting-7770-4310/external-snapshotter-leaderelection-snapshotting-7770 Jun 19 07:11:50.765: INFO: creating *v1.RoleBinding: snapshotting-7770-4310/external-snapshotter-leaderelection Jun 19 07:11:50.802: INFO: creating *v1.ServiceAccount: snapshotting-7770-4310/csi-external-health-monitor-controller Jun 19 07:11:50.837: INFO: creating *v1.ClusterRole: external-health-monitor-controller-runner-snapshotting-7770 Jun 19 07:11:50.837: INFO: Define cluster role external-health-monitor-controller-runner-snapshotting-7770 Jun 19 07:11:50.875: INFO: creating *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-snapshotting-7770 Jun 19 07:11:50.911: INFO: creating *v1.Role: snapshotting-7770-4310/external-health-monitor-controller-cfg-snapshotting-7770 Jun 19 07:11:50.947: INFO: creating *v1.RoleBinding: snapshotting-7770-4310/csi-external-health-monitor-controller-role-cfg Jun 19 07:11:50.988: INFO: creating *v1.ServiceAccount: snapshotting-7770-4310/csi-resizer Jun 19 07:11:51.024: INFO: creating *v1.ClusterRole: external-resizer-runner-snapshotting-7770 Jun 19 07:11:51.024: INFO: Define cluster role external-resizer-runner-snapshotting-7770 Jun 19 07:11:51.062: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-snapshotting-7770 Jun 19 07:11:51.098: INFO: creating *v1.Role: snapshotting-7770-4310/external-resizer-cfg-snapshotting-7770 Jun 19 07:11:51.134: INFO: creating *v1.RoleBinding: snapshotting-7770-4310/csi-resizer-role-cfg Jun 19 07:11:51.171: INFO: creating *v1.CSIDriver: csi-hostpath-snapshotting-7770 Jun 19 07:11:51.208: INFO: creating *v1.ServiceAccount: snapshotting-7770-4310/csi-hostpathplugin-sa Jun 19 07:11:51.244: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-snapshotting-7770 Jun 19 07:11:51.280: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-snapshotting-7770 Jun 19 07:11:51.316: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-snapshotting-7770 Jun 19 07:11:51.353: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-snapshotting-7770 Jun 19 07:11:51.390: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-snapshotting-7770 Jun 19 07:11:51.426: INFO: creating *v1.RoleBinding: snapshotting-7770-4310/csi-hostpathplugin-attacher-role Jun 19 07:11:51.462: INFO: creating *v1.RoleBinding: snapshotting-7770-4310/csi-hostpathplugin-health-monitor-controller-role Jun 19 07:11:51.499: INFO: creating *v1.RoleBinding: snapshotting-7770-4310/csi-hostpathplugin-provisioner-role Jun 19 07:11:51.535: INFO: creating *v1.RoleBinding: snapshotting-7770-4310/csi-hostpathplugin-resizer-role Jun 19 07:11:51.571: INFO: creating *v1.RoleBinding: snapshotting-7770-4310/csi-hostpathplugin-snapshotter-role Jun 19 07:11:51.607: INFO: creating *v1.StatefulSet: snapshotting-7770-4310/csi-hostpathplugin Jun 19 07:11:51.656: INFO: creating *v1.ClusterRoleBinding: psp-csi-hostpath-role-snapshotting-7770 Jun 19 07:11:51.694: INFO: Creating resource for dynamic PV Jun 19 07:11:51.694: INFO: Using claimSize:1Mi, test suite supported size:{ 1Mi}, driver(csi-hostpath) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-7770tqcs6 �[1mSTEP�[0m: creating a claim Jun 19 07:11:51.755: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Jun 19 07:11:51.793: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [csi-hostpath2hc7h] to have phase Bound Jun 19 07:11:51.828: INFO: PersistentVolumeClaim csi-hostpath2hc7h found but phase is Pending instead of Bound. Jun 19 07:11:53.864: INFO: PersistentVolumeClaim csi-hostpath2hc7h found but phase is Pending instead of Bound. Jun 19 07:11:55.900: INFO: PersistentVolumeClaim csi-hostpath2hc7h found and phase=Bound (4.107323735s) �[1mSTEP�[0m: [init] starting a pod to use the claim �[1mSTEP�[0m: [init] check pod success Jun 19 07:11:56.050: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-g8td5" in namespace "snapshotting-7770" to be "Succeeded or Failed" Jun 19 07:11:56.085: INFO: Pod "pvc-snapshottable-tester-g8td5": Phase="Pending", Reason="", readiness=false. Elapsed: 35.214443ms Jun 19 07:11:58.121: INFO: Pod "pvc-snapshottable-tester-g8td5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071395489s Jun 19 07:12:00.121: INFO: Pod "pvc-snapshottable-tester-g8td5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.071469218s Jun 19 07:12:02.124: INFO: Pod "pvc-snapshottable-tester-g8td5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.074284399s �[1mSTEP�[0m: Saw pod success Jun 19 07:12:02.124: INFO: Pod "pvc-snapshottable-tester-g8td5" satisfied condition "Succeeded or Failed" �[1mSTEP�[0m: [init] checking the claim Jun 19 07:12:02.160: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [csi-hostpath2hc7h] to have phase Bound Jun 19 07:12:02.196: INFO: PersistentVolumeClaim csi-hostpath2hc7h found and phase=Bound (35.317375ms) �[1mSTEP�[0m: [init] checking the PV �[1mSTEP�[0m: [init] deleting the pod Jun 19 07:12:02.333: INFO: Pod pvc-snapshottable-tester-g8td5 has the following logs: Jun 19 07:12:02.333: INFO: Deleting pod "pvc-snapshottable-tester-g8td5" in namespace "snapshotting-7770" Jun 19 07:12:02.379: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-g8td5" to be fully deleted �[1mSTEP�[0m: [init] waiting until the node=bootstrap-e2e-minion-group-v98m is not using the volume=19059116-ef9f-11ec-9f8a-1e9c7da8cda7 Jun 19 07:12:02.451: INFO: current volumes in use: [kubernetes.io/csi/csi-hostpath-snapshotting-7770^19059116-ef9f-11ec-9f8a-1e9c7da8cda7] Jun 19 07:12:04.488: INFO: current volumes in use: [kubernetes.io/csi/csi-hostpath-snapshotting-7770^19059116-ef9f-11ec-9f8a-1e9c7da8cda7] Jun 19 07:12:06.525: INFO: current volumes in use: [kubernetes.io/csi/csi-hostpath-snapshotting-7770^19059116-ef9f-11ec-9f8a-1e9c7da8cda7] Jun 19 07:12:08.563: INFO: current volumes in use: [] Jun 19 07:12:08.563: INFO: WaitUntil finished successfully after 6.14803925s �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 19 07:12:08.679: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-76cfz to become ready Jun 19 07:12:08.731: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:10.768: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:12.805: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:14.842: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:16.880: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:18.917: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:20.954: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:22.992: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:25.029: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:27.073: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:29.110: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:31.148: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:33.231: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:35.268: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:37.305: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:39.342: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:41.379: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:43.415: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:45.453: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:47.491: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:49.527: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:51.564: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:53.601: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:55.649: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:57.690: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:12:59.726: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:01.761: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:03.797: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:05.833: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:07.871: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:09.908: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:11.946: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:13.983: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:16.022: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:18.060: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:20.096: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:22.133: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:24.202: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:26.239: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:28.276: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:30.313: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:32.351: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:34.388: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:36.426: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:38.463: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:40.501: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:42.538: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:44.576: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:46.614: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:48.650: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:50.689: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:52.729: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:54.765: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:56.802: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:13:58.839: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:00.876: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:02.912: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:04.949: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:06.985: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:09.022: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:11.059: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:13.095: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:15.132: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:17.169: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:19.205: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:21.242: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:23.278: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:25.315: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:27.353: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:29.389: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:31.426: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:33.462: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:35.500: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:37.536: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:39.573: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:41.610: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:43.646: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:45.683: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:47.720: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:49.758: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:51.795: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:53.832: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:55.868: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:57.905: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:14:59.943: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:01.980: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:04.016: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:06.052: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:08.093: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:10.130: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:12.168: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:14.255: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:16.291: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:18.328: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:20.364: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:22.402: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:24.439: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:26.476: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:28.514: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:30.551: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:32.589: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:34.627: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:36.663: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:38.700: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:40.738: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:42.774: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:44.820: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:46.856: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:48.892: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:50.929: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:52.966: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:55.004: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:57.041: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:15:59.078: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:01.115: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:03.153: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:05.192: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:07.229: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:09.266: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:11.304: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:13.341: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:15.378: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:17.416: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:19.454: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:21.491: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:23.529: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:25.566: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:27.603: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:29.641: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:31.678: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:33.715: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:35.751: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:37.789: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:39.826: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:41.862: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:43.898: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:45.935: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:47.974: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:50.010: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:52.048: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:54.085: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:56.123: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:16:58.161: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:17:00.198: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:17:02.236: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:17:04.274: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:17:06.312: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:17:08.349: INFO: VolumeSnapshot snapshot-76cfz found but is not ready. Jun 19 07:17:10.349: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 19 07:17:10.350: INFO: Unexpected error: <*errors.errorString | 0xc002706260>: { s: "VolumeSnapshot snapshot-76cfz is not ready within 5m0s", } Jun 19 07:17:10.350: FAIL: VolumeSnapshot snapshot-76cfz is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc003bca3f8?}, 0xc0037f5348) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f9d66eec7d8, 0xc0010b5c00}, 0xc002f24480, {{0x71fffd4, 0x28}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.4.2() test/e2e/storage/testsuites/snapshottable.go:359 +0xb7d k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: updating the snapshot content deletion policy to retain [AfterEach] volume snapshot controller test/e2e/storage/testsuites/snapshottable.go:172 �[1mSTEP�[0m: Deleting pvc Jun 19 07:17:10.351: INFO: Deleting PersistentVolumeClaim "csi-hostpath2hc7h" Jun 19 07:17:10.389: INFO: Waiting up to 5m0s for PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 to get deleted Jun 19 07:17:10.427: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (38.046379ms) Jun 19 07:17:15.462: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (5.073745399s) Jun 19 07:17:20.499: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (10.110083532s) Jun 19 07:17:25.535: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (15.146392606s) Jun 19 07:17:30.572: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (20.183424257s) Jun 19 07:17:35.609: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (25.219985191s) Jun 19 07:17:40.645: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (30.256164443s) Jun 19 07:17:45.681: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (35.292196879s) Jun 19 07:17:50.717: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (40.328658514s) Jun 19 07:17:55.753: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (45.364213345s) Jun 19 07:18:00.789: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (50.400671512s) Jun 19 07:18:05.825: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (55.435903689s) Jun 19 07:18:10.860: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m0.471298116s) Jun 19 07:18:15.924: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m5.535191021s) Jun 19 07:18:20.960: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m10.571162853s) Jun 19 07:18:25.997: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m15.608301608s) Jun 19 07:18:31.033: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m20.644403514s) Jun 19 07:18:36.071: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m25.682328436s) Jun 19 07:18:41.107: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m30.718289035s) Jun 19 07:18:46.143: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m35.754092558s) Jun 19 07:18:51.180: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m40.791033904s) Jun 19 07:18:56.216: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m45.826938641s) Jun 19 07:19:01.253: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m50.864349425s) Jun 19 07:19:06.289: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (1m55.900434899s) Jun 19 07:19:11.326: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m0.936940654s) Jun 19 07:19:16.362: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m5.972944916s) Jun 19 07:19:21.397: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m11.008406259s) Jun 19 07:19:26.434: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m16.045838658s) Jun 19 07:19:31.471: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m21.081854715s) Jun 19 07:19:36.507: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m26.118159324s) Jun 19 07:19:41.544: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m31.155144324s) Jun 19 07:19:46.580: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m36.191522076s) Jun 19 07:19:51.616: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m41.227601065s) Jun 19 07:19:56.652: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m46.263684487s) Jun 19 07:20:01.689: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m51.300581409s) Jun 19 07:20:06.726: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (2m56.337274889s) Jun 19 07:20:11.791: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m1.402522616s) Jun 19 07:20:16.827: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m6.438516405s) Jun 19 07:20:21.913: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m11.524699242s) Jun 19 07:20:27.013: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m16.624271265s) Jun 19 07:20:32.063: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m21.674642975s) Jun 19 07:20:37.164: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m26.774898168s) Jun 19 07:20:42.264: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m31.875102698s) Jun 19 07:20:47.314: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m36.925447205s) Jun 19 07:20:52.364: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m41.975569412s) Jun 19 07:20:57.415: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m47.025962886s) Jun 19 07:21:02.513: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m52.124345547s) Jun 19 07:21:07.563: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (3m57.174530273s) Jun 19 07:21:12.613: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m2.224409102s) Jun 19 07:21:17.663: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m7.274729866s) Jun 19 07:21:22.713: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m12.324476834s) Jun 19 07:21:27.820: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m17.431361325s) Jun 19 07:21:32.864: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m22.474903712s) Jun 19 07:21:37.914: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m27.525777471s) Jun 19 07:21:42.964: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m32.575636454s) Jun 19 07:21:48.015: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m37.625899571s) Jun 19 07:21:53.114: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m42.725037004s) Jun 19 07:21:58.163: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m47.774544597s) Jun 19 07:22:03.214: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m52.825239303s) Jun 19 07:22:08.315: INFO: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 found and phase=Bound (4m57.925937593s) �[1mSTEP�[0m: Deleting sc Jun 19 07:22:13.415: INFO: Unexpected error: <errors.aggregate | len:1, cap:1>: [ { msg: "persistent Volume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 not deleted by dynamic provisioner: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 still exists within 5m0s", err: { s: "PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 still exists within 5m0s", }, }, ] Jun 19 07:22:13.416: FAIL: persistent Volume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 not deleted by dynamic provisioner: PersistentVolume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 still exists within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.1.1() test/e2e/storage/testsuites/snapshottable.go:142 +0x3c k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0xc000e79800?) test/e2e/storage/utils/utils.go:714 +0x6d k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.2() test/e2e/storage/testsuites/snapshottable.go:167 +0x38 k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.3() test/e2e/storage/testsuites/snapshottable.go:173 +0x1b k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: deleting the test namespace: snapshotting-7770 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-7770". �[1mSTEP�[0m: Found 11 events. Jun 19 07:22:13.514: INFO: At 2022-06-19 07:11:51 +0000 UTC - event for csi-hostpath2hc7h: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "csi-hostpath-snapshotting-7770" or manually created by system administrator Jun 19 07:22:13.515: INFO: At 2022-06-19 07:11:53 +0000 UTC - event for csi-hostpath2hc7h: {csi-hostpath-snapshotting-7770_csi-hostpathplugin-0_274d94e9-0c5e-4b2e-8d4e-156b1dd05bc2 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-7770/csi-hostpath2hc7h" Jun 19 07:22:13.516: INFO: At 2022-06-19 07:11:53 +0000 UTC - event for csi-hostpath2hc7h: {csi-hostpath-snapshotting-7770_csi-hostpathplugin-0_274d94e9-0c5e-4b2e-8d4e-156b1dd05bc2 } ProvisioningFailed: failed to provision volume with StorageClass "snapshotting-7770tqcs6": error generating accessibility requirements: no available topology found Jun 19 07:22:13.516: INFO: At 2022-06-19 07:11:54 +0000 UTC - event for csi-hostpath2hc7h: {csi-hostpath-snapshotting-7770_csi-hostpathplugin-0_274d94e9-0c5e-4b2e-8d4e-156b1dd05bc2 } ProvisioningSucceeded: Successfully provisioned volume pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9 Jun 19 07:22:13.517: INFO: At 2022-06-19 07:11:56 +0000 UTC - event for pvc-snapshottable-tester-g8td5: {default-scheduler } Scheduled: Successfully assigned snapshotting-7770/pvc-snapshottable-tester-g8td5 to bootstrap-e2e-minion-group-v98m Jun 19 07:22:13.517: INFO: At 2022-06-19 07:11:56 +0000 UTC - event for pvc-snapshottable-tester-g8td5: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-1fadfe7e-d875-4143-abd4-fc3dab1c1ec9" Jun 19 07:22:13.517: INFO: At 2022-06-19 07:11:57 +0000 UTC - event for pvc-snapshottable-tester-g8td5: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 19 07:22:13.517: INFO: At 2022-06-19 07:11:58 +0000 UTC - event for pvc-snapshottable-tester-g8td5: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container volume-tester Jun 19 07:22:13.517: INFO: At 2022-06-19 07:11:58 +0000 UTC - event for pvc-snapshottable-tester-g8td5: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container volume-tester Jun 19 07:22:13.517: INFO: At 2022-06-19 07:12:08 +0000 UTC - event for snapshot-76cfz: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-7770/snapshot-76cfz to be created by the CSI driver. Jun 19 07:22:13.517: INFO: At 2022-06-19 07:12:08 +0000 UTC - event for snapshot-76cfz: {snapshot-controller } SnapshotFinalizerError: Failed to check and update snapshot: snapshot controller failed to update snapshotting-7770/snapshot-76cfz on API server: volumesnapshots.snapshot.storage.k8s.io "snapshot-76cfz" is forbidden: User "system:serviceaccount:kube-system:volume-snapshot-controller" cannot patch resource "volumesnapshots" in API group "snapshot.storage.k8s.io" in the namespace "snapshotting-7770" Jun 19 07:22:13.613: INFO: POD NODE PHASE GRACE CONDITIONS Jun 19 07:22:13.613: INFO: Jun 19 07:22:13.716: INFO: Logging node info for node bootstrap-e2e-master Jun 19 07:22:13.820: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master b70a79b4-f34d-45f8-938e-6f3b3224ddac 14920 0 2022-06-19 05:52:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 07:21:27 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:27 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:27 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:27 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 07:21:27 +0000 UTC,LastTransitionTime:2022-06-19 05:52:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.127.118.154,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d48293e9fabdc7ca70d161b06af3da10,SystemUUID:d48293e9-fabd-c7ca-70d1-61b06af3da10,BootID:0f6cfa59-e1ee-4de4-bf6f-4e1f12698e99,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:117361473,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 07:22:13.820: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 19 07:22:13.914: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 19 07:22:14.032: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.032: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 19 07:22:14.032: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.032: INFO: Container kube-scheduler ready: true, restart count 0 Jun 19 07:22:14.032: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-19 05:51:08 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.032: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 19 07:22:14.032: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.032: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 19 07:22:14.032: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.032: INFO: Container kube-apiserver ready: true, restart count 0 Jun 19 07:22:14.032: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.032: INFO: Container etcd-container ready: true, restart count 0 Jun 19 07:22:14.032: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.032: INFO: Container etcd-container ready: true, restart count 0 Jun 19 07:22:14.032: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.032: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 19 07:22:14.032: INFO: metadata-proxy-v0.1-dftl5 started at 2022-06-19 05:52:34 +0000 UTC (0+2 container statuses recorded) Jun 19 07:22:14.032: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 07:22:14.032: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 07:22:14.394: INFO: Latency metrics for node bootstrap-e2e-master Jun 19 07:22:14.394: INFO: Logging node info for node bootstrap-e2e-minion-group-qcp1 Jun 19 07:22:14.464: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qcp1 f578c18d-9d7d-4046-a3c5-035049291f46 14903 0 2022-06-19 05:52:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qcp1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-19 07:17:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-19 07:21:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-qcp1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821426688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559282688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 07:17:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 07:17:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 07:17:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 07:17:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 07:17:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 07:17:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 07:17:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:19 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:19 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:19 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 07:21:19 +0000 UTC,LastTransitionTime:2022-06-19 05:52:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.199.146.124,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23ad93bfd15643880ef5ec43ad77f973,SystemUUID:23ad93bf-d156-4388-0ef5-ec43ad77f973,BootID:7ac23b1d-549e-44ef-9eaa-3dbb749ded08,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 07:22:14.464: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-qcp1 Jun 19 07:22:14.563: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qcp1 Jun 19 07:22:14.702: INFO: l7-default-backend-5f6f9745f9-7t4pf started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.702: INFO: Container default-http-backend ready: true, restart count 0 Jun 19 07:22:14.702: INFO: konnectivity-agent-z92tr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.702: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 07:22:14.702: INFO: kube-proxy-bootstrap-e2e-minion-group-qcp1 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.702: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 07:22:14.702: INFO: metadata-proxy-v0.1-8p6rv started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 07:22:14.702: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 07:22:14.702: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 07:22:14.702: INFO: coredns-85bc9d67b-hzkc7 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.702: INFO: Container coredns ready: true, restart count 0 Jun 19 07:22:14.702: INFO: volume-snapshot-controller-0 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.702: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 19 07:22:14.702: INFO: kube-dns-autoscaler-5477bd659c-plscr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:14.702: INFO: Container autoscaler ready: true, restart count 0 Jun 19 07:22:15.015: INFO: Latency metrics for node bootstrap-e2e-minion-group-qcp1 Jun 19 07:22:15.015: INFO: Logging node info for node bootstrap-e2e-minion-group-v98m Jun 19 07:22:15.114: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-v98m 75fa2a8c-51fd-4106-aa37-3a44a456bdf3 14474 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-v98m kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-v98m topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-snapshotting-7770":"bootstrap-e2e-minion-group-v98m"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 07:11:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 07:17:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 07:17:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-v98m,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 07:17:14 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 07:17:14 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 07:17:14 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 07:17:14 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.168.72.251,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:471d705f22032fce16758d01e419fd6f,SystemUUID:471d705f-2203-2fce-1675-8d01e419fd6f,BootID:1ec48621-6cc9-4851-bac7-4039e6e09109,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:dc0301d9a43e23e389abb7690cd631f98af76ea3429259c7f5f643fd31fc0a3e registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0],SizeBytes:27914152,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 07:22:15.115: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-v98m Jun 19 07:22:15.213: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-v98m Jun 19 07:22:15.350: INFO: csi-hostpathplugin-0 started at 2022-06-19 07:11:51 +0000 UTC (0+7 container statuses recorded) Jun 19 07:22:15.350: INFO: Container csi-attacher ready: true, restart count 0 Jun 19 07:22:15.350: INFO: Container csi-provisioner ready: true, restart count 0 Jun 19 07:22:15.350: INFO: Container csi-resizer ready: true, restart count 0 Jun 19 07:22:15.350: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 19 07:22:15.350: INFO: Container hostpath ready: true, restart count 0 Jun 19 07:22:15.350: INFO: Container liveness-probe ready: true, restart count 0 Jun 19 07:22:15.350: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 19 07:22:15.350: INFO: kube-proxy-bootstrap-e2e-minion-group-v98m started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:15.350: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 07:22:15.350: INFO: metadata-proxy-v0.1-spzmg started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 07:22:15.350: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 07:22:15.350: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 07:22:15.350: INFO: konnectivity-agent-87hwr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:15.350: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 07:22:15.350: INFO: metrics-server-v0.5.2-755d66fb57-jtgcf started at 2022-06-19 05:53:00 +0000 UTC (0+2 container statuses recorded) Jun 19 07:22:15.350: INFO: Container metrics-server ready: true, restart count 0 Jun 19 07:22:15.350: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 19 07:22:15.685: INFO: Latency metrics for node bootstrap-e2e-minion-group-v98m Jun 19 07:22:15.686: INFO: Logging node info for node bootstrap-e2e-minion-group-vg14 Jun 19 07:22:15.763: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-vg14 1d72ee75-4603-4a55-b2e8-270e62899bc0 14982 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-vg14 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-vg14 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 06:35:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-19 07:17:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-19 07:21:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-vg14,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 07:17:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:59 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:59 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:59 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 07:21:59 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.23.69,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39085846033450b547007ba5da404b34,SystemUUID:39085846-0334-50b5-4700-7ba5da404b34,BootID:9d0a40ab-cad4-4158-bdf2-064a38204d74,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 07:22:15.763: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-vg14 Jun 19 07:22:15.863: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-vg14 Jun 19 07:22:15.989: INFO: kube-proxy-bootstrap-e2e-minion-group-vg14 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:15.989: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 07:22:15.989: INFO: metadata-proxy-v0.1-p2ll4 started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 07:22:15.989: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 07:22:15.989: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 07:22:15.989: INFO: konnectivity-agent-8srbc started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:15.989: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 07:22:15.989: INFO: coredns-85bc9d67b-rdq7m started at 2022-06-19 05:52:52 +0000 UTC (0+1 container statuses recorded) Jun 19 07:22:15.989: INFO: Container coredns ready: true, restart count 0 Jun 19 07:22:16.360: INFO: Latency metrics for node bootstrap-e2e-minion-group-vg14 �[1mSTEP�[0m: Waiting for namespaces [snapshotting-7770] to vanish �[1mSTEP�[0m: uninstalling csi csi-hostpath driver Jun 19 07:23:00.517: INFO: deleting *v1.ServiceAccount: snapshotting-7770-4310/csi-attacher Jun 19 07:23:00.616: INFO: deleting *v1.ClusterRole: external-attacher-runner-snapshotting-7770 Jun 19 07:23:00.714: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-7770 Jun 19 07:23:00.820: INFO: deleting *v1.Role: snapshotting-7770-4310/external-attacher-cfg-snapshotting-7770 Jun 19 07:23:00.915: INFO: deleting *v1.RoleBinding: snapshotting-7770-4310/csi-attacher-role-cfg Jun 19 07:23:01.015: INFO: deleting *v1.ServiceAccount: snapshotting-7770-4310/csi-provisioner Jun 19 07:23:01.115: INFO: deleting *v1.ClusterRole: external-provisioner-runner-snapshotting-7770 Jun 19 07:23:01.214: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-7770 Jun 19 07:23:01.348: INFO: deleting *v1.Role: snapshotting-7770-4310/external-provisioner-cfg-snapshotting-7770 Jun 19 07:23:01.414: INFO: deleting *v1.RoleBinding: snapshotting-7770-4310/csi-provisioner-role-cfg Jun 19 07:23:01.515: INFO: deleting *v1.ServiceAccount: snapshotting-7770-4310/csi-snapshotter Jun 19 07:23:01.617: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-snapshotting-7770 Jun 19 07:23:01.715: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-snapshotting-7770 Jun 19 07:23:01.828: INFO: deleting *v1.Role: snapshotting-7770-4310/external-snapshotter-leaderelection-snapshotting-7770 Jun 19 07:23:01.915: INFO: deleting *v1.RoleBinding: snapshotting-7770-4310/external-snapshotter-leaderelection Jun 19 07:23:02.014: INFO: deleting *v1.ServiceAccount: snapshotting-7770-4310/csi-external-health-monitor-controller Jun 19 07:23:02.120: INFO: deleting *v1.ClusterRole: external-health-monitor-controller-runner-snapshotting-7770 Jun 19 07:23:02.215: INFO: deleting *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-snapshotting-7770 Jun 19 07:23:02.314: INFO: deleting *v1.Role: snapshotting-7770-4310/external-health-monitor-controller-cfg-snapshotting-7770 Jun 19 07:23:02.415: INFO: deleting *v1.RoleBinding: snapshotting-7770-4310/csi-external-health-monitor-controller-role-cfg Jun 19 07:23:02.517: INFO: deleting *v1.ServiceAccount: snapshotting-7770-4310/csi-resizer Jun 19 07:23:02.615: INFO: deleting *v1.ClusterRole: external-resizer-runner-snapshotting-7770 Jun 19 07:23:02.716: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-snapshotting-7770 Jun 19 07:23:02.823: INFO: deleting *v1.Role: snapshotting-7770-4310/external-resizer-cfg-snapshotting-7770 Jun 19 07:23:02.916: INFO: deleting *v1.RoleBinding: snapshotting-7770-4310/csi-resizer-role-cfg Jun 19 07:23:03.016: INFO: deleting *v1.CSIDriver: csi-hostpath-snapshotting-7770 Jun 19 07:23:03.116: INFO: deleting *v1.ServiceAccount: snapshotting-7770-4310/csi-hostpathplugin-sa Jun 19 07:23:03.215: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-snapshotting-7770 Jun 19 07:23:03.314: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-snapshotting-7770 Jun 19 07:23:03.415: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-snapshotting-7770 Jun 19 07:23:03.518: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-snapshotting-7770 Jun 19 07:23:03.632: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-snapshotting-7770 Jun 19 07:23:03.714: INFO: deleting *v1.RoleBinding: snapshotting-7770-4310/csi-hostpathplugin-attacher-role Jun 19 07:23:03.819: INFO: deleting *v1.RoleBinding: snapshotting-7770-4310/csi-hostpathplugin-health-monitor-controller-role Jun 19 07:23:03.915: INFO: deleting *v1.RoleBinding: snapshotting-7770-4310/csi-hostpathplugin-provisioner-role Jun 19 07:23:04.015: INFO: deleting *v1.RoleBinding: snapshotting-7770-4310/csi-hostpathplugin-resizer-role Jun 19 07:23:04.115: INFO: deleting *v1.RoleBinding: snapshotting-7770-4310/csi-hostpathplugin-snapshotter-role Jun 19 07:23:04.215: INFO: deleting *v1.StatefulSet: snapshotting-7770-4310/csi-hostpathplugin Jun 19 07:23:04.315: INFO: deleting *v1.ClusterRoleBinding: psp-csi-hostpath-role-snapshotting-7770 �[1mSTEP�[0m: deleting the driver namespace: snapshotting-7770-4310 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-7770-4310". �[1mSTEP�[0m: Found 29 events. Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:51 +0000 UTC - event for csi-hostpathplugin: {statefulset-controller } SuccessfulCreate: create Pod csi-hostpathplugin-0 in StatefulSet csi-hostpathplugin successful Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:51 +0000 UTC - event for csi-hostpathplugin-0: {default-scheduler } Scheduled: Successfully assigned snapshotting-7770-4310/csi-hostpathplugin-0 to bootstrap-e2e-minion-group-v98m Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-snapshotter Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container hostpath Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0" already present on machine Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container node-driver-registrar Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container node-driver-registrar Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/livenessprobe:v2.6.0" already present on machine Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container liveness-probe Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container liveness-probe Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-attacher:v3.4.0" already present on machine Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-attacher Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-attacher Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-provisioner:v3.1.0" already present on machine Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/hostpathplugin:v1.7.3" already present on machine Jun 19 07:23:04.514: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-provisioner Jun 19 07:23:04.515: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-resizer:v1.4.0" already present on machine Jun 19 07:23:04.515: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-resizer Jun 19 07:23:04.515: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-resizer Jun 19 07:23:04.515: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1" already present on machine Jun 19 07:23:04.515: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container hostpath Jun 19 07:23:04.515: INFO: At 2022-06-19 07:11:52 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-provisioner Jun 19 07:23:04.515: INFO: At 2022-06-19 07:11:53 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-snapshotter Jun 19 07:23:04.515: INFO: At 2022-06-19 07:23:04 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Killing: Stopping container csi-resizer Jun 19 07:23:04.515: INFO: At 2022-06-19 07:23:04 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Killing: Stopping container csi-provisioner Jun 19 07:23:04.515: INFO: At 2022-06-19 07:23:04 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Killing: Stopping container csi-attacher Jun 19 07:23:04.515: INFO: At 2022-06-19 07:23:04 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Killing: Stopping container liveness-probe Jun 19 07:23:04.515: INFO: At 2022-06-19 07:23:04 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Killing: Stopping container node-driver-registrar Jun 19 07:23:04.515: INFO: At 2022-06-19 07:23:04 +0000 UTC - event for csi-hostpathplugin-0: {kubelet bootstrap-e2e-minion-group-v98m} Killing: Stopping container hostpath Jun 19 07:23:04.614: INFO: POD NODE PHASE GRACE CONDITIONS Jun 19 07:23:04.614: INFO: csi-hostpathplugin-0 bootstrap-e2e-minion-group-v98m Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 07:11:51 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 07:11:54 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 07:11:54 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 07:11:51 +0000 UTC }] Jun 19 07:23:04.614: INFO: Jun 19 07:23:05.015: INFO: Logging node info for node bootstrap-e2e-master Jun 19 07:23:05.064: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master b70a79b4-f34d-45f8-938e-6f3b3224ddac 14920 0 2022-06-19 05:52:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 07:21:27 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:27 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:27 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:27 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 07:21:27 +0000 UTC,LastTransitionTime:2022-06-19 05:52:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.127.118.154,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d48293e9fabdc7ca70d161b06af3da10,SystemUUID:d48293e9-fabd-c7ca-70d1-61b06af3da10,BootID:0f6cfa59-e1ee-4de4-bf6f-4e1f12698e99,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:117361473,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 07:23:05.065: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 19 07:23:05.114: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 19 07:23:05.172: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.172: INFO: Container kube-apiserver ready: true, restart count 0 Jun 19 07:23:05.172: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.172: INFO: Container etcd-container ready: true, restart count 0 Jun 19 07:23:05.172: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.172: INFO: Container etcd-container ready: true, restart count 0 Jun 19 07:23:05.172: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.172: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 19 07:23:05.172: INFO: metadata-proxy-v0.1-dftl5 started at 2022-06-19 05:52:34 +0000 UTC (0+2 container statuses recorded) Jun 19 07:23:05.172: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 07:23:05.172: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 07:23:05.172: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.172: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 19 07:23:05.172: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.172: INFO: Container kube-scheduler ready: true, restart count 0 Jun 19 07:23:05.172: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-19 05:51:08 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.172: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 19 07:23:05.172: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.172: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 19 07:23:05.405: INFO: Latency metrics for node bootstrap-e2e-master Jun 19 07:23:05.405: INFO: Logging node info for node bootstrap-e2e-minion-group-qcp1 Jun 19 07:23:05.444: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qcp1 f578c18d-9d7d-4046-a3c5-035049291f46 15079 0 2022-06-19 05:52:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qcp1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 07:21:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 07:22:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-qcp1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821426688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559282688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 07:22:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 07:22:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 07:22:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 07:22:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 07:22:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 07:22:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 07:22:42 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:19 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:19 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:19 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 07:21:19 +0000 UTC,LastTransitionTime:2022-06-19 05:52:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.199.146.124,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23ad93bfd15643880ef5ec43ad77f973,SystemUUID:23ad93bf-d156-4388-0ef5-ec43ad77f973,BootID:7ac23b1d-549e-44ef-9eaa-3dbb749ded08,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 07:23:05.444: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-qcp1 Jun 19 07:23:05.479: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qcp1 Jun 19 07:23:05.521: INFO: coredns-85bc9d67b-hzkc7 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.521: INFO: Container coredns ready: true, restart count 0 Jun 19 07:23:05.521: INFO: volume-snapshot-controller-0 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.521: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 19 07:23:05.521: INFO: kube-dns-autoscaler-5477bd659c-plscr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.521: INFO: Container autoscaler ready: true, restart count 0 Jun 19 07:23:05.521: INFO: l7-default-backend-5f6f9745f9-7t4pf started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.521: INFO: Container default-http-backend ready: true, restart count 0 Jun 19 07:23:05.521: INFO: konnectivity-agent-z92tr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.521: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 07:23:05.521: INFO: kube-proxy-bootstrap-e2e-minion-group-qcp1 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.521: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 07:23:05.521: INFO: metadata-proxy-v0.1-8p6rv started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 07:23:05.521: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 07:23:05.521: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 07:23:05.688: INFO: Latency metrics for node bootstrap-e2e-minion-group-qcp1 Jun 19 07:23:05.688: INFO: Logging node info for node bootstrap-e2e-minion-group-v98m Jun 19 07:23:05.724: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-v98m 75fa2a8c-51fd-4106-aa37-3a44a456bdf3 15178 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-v98m kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-v98m topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 07:11:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 07:22:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 07:22:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-v98m,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 07:22:20 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 07:22:20 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 07:22:20 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 07:22:20 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.168.72.251,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:471d705f22032fce16758d01e419fd6f,SystemUUID:471d705f-2203-2fce-1675-8d01e419fd6f,BootID:1ec48621-6cc9-4851-bac7-4039e6e09109,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:dc0301d9a43e23e389abb7690cd631f98af76ea3429259c7f5f643fd31fc0a3e registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0],SizeBytes:27914152,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 07:23:05.725: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-v98m Jun 19 07:23:05.760: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-v98m Jun 19 07:23:05.802: INFO: metrics-server-v0.5.2-755d66fb57-jtgcf started at 2022-06-19 05:53:00 +0000 UTC (0+2 container statuses recorded) Jun 19 07:23:05.802: INFO: Container metrics-server ready: true, restart count 0 Jun 19 07:23:05.802: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 19 07:23:05.802: INFO: kube-proxy-bootstrap-e2e-minion-group-v98m started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.802: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 07:23:05.802: INFO: metadata-proxy-v0.1-spzmg started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 07:23:05.802: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 07:23:05.802: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 07:23:05.802: INFO: konnectivity-agent-87hwr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:05.802: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 07:23:05.964: INFO: Latency metrics for node bootstrap-e2e-minion-group-v98m Jun 19 07:23:05.964: INFO: Logging node info for node bootstrap-e2e-minion-group-vg14 Jun 19 07:23:06.001: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-vg14 1d72ee75-4603-4a55-b2e8-270e62899bc0 15080 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-vg14 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-vg14 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 06:35:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 07:21:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 07:22:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-vg14,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 07:22:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:59 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:59 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 07:21:59 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 07:21:59 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.23.69,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39085846033450b547007ba5da404b34,SystemUUID:39085846-0334-50b5-4700-7ba5da404b34,BootID:9d0a40ab-cad4-4158-bdf2-064a38204d74,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 07:23:06.001: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-vg14 Jun 19 07:23:06.036: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-vg14 Jun 19 07:23:06.078: INFO: coredns-85bc9d67b-rdq7m started at 2022-06-19 05:52:52 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:06.078: INFO: Container coredns ready: true, restart count 0 Jun 19 07:23:06.078: INFO: kube-proxy-bootstrap-e2e-minion-group-vg14 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:06.078: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 07:23:06.078: INFO: metadata-proxy-v0.1-p2ll4 started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 07:23:06.078: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 07:23:06.078: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 07:23:06.078: INFO: konnectivity-agent-8srbc started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 07:23:06.078: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 07:23:06.253: INFO: Latency metrics for node bootstrap-e2e-minion-group-vg14 �[1mSTEP�[0m: Waiting for namespaces [snapshotting-7770-4310] to vanish [AfterEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:187 Jun 19 07:23:12.331: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\spd\.csi\.storage\.gke\.io\]\[Serial\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\]\sprovisioning\sshould\sprovision\sstorage\swith\ssnapshot\sdata\ssource\s\[Feature\:VolumeSnapshotDataSource\]$'
test/e2e/storage/testsuites/provisioning.go:208 Jun 19 06:41:02.965: VolumeSnapshot snapshot-ct8hj is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 19 06:35:32.288: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource] test/e2e/storage/testsuites/provisioning.go:208 �[1mSTEP�[0m: deploying csi gce-pd driver �[1mSTEP�[0m: Building a driver namespace object, basename provisioning-689 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace Jun 19 06:35:32.829: INFO: Found CI service account key at /etc/service-account/service-account.json Jun 19 06:35:32.829: INFO: Running cp [/etc/service-account/service-account.json /tmp/3b06d6c5-ad41-4937-91f7-e539a1d129b0/cloud-sa.json] Jun 19 06:35:32.869: INFO: Shredding file /tmp/3b06d6c5-ad41-4937-91f7-e539a1d129b0/cloud-sa.json Jun 19 06:35:32.869: INFO: Running shred [--remove /tmp/3b06d6c5-ad41-4937-91f7-e539a1d129b0/cloud-sa.json] Jun 19 06:35:32.905: INFO: File /tmp/3b06d6c5-ad41-4937-91f7-e539a1d129b0/cloud-sa.json successfully shredded Jun 19 06:35:32.919: INFO: creating *v1.ServiceAccount: provisioning-689-230/csi-attacher Jun 19 06:35:32.957: INFO: creating *v1.ClusterRole: external-attacher-runner-provisioning-689 Jun 19 06:35:32.957: INFO: Define cluster role external-attacher-runner-provisioning-689 Jun 19 06:35:32.996: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-provisioning-689 Jun 19 06:35:33.032: INFO: creating *v1.Role: provisioning-689-230/external-attacher-cfg-provisioning-689 Jun 19 06:35:33.069: INFO: creating *v1.RoleBinding: provisioning-689-230/csi-attacher-role-cfg Jun 19 06:35:33.107: INFO: creating *v1.ServiceAccount: provisioning-689-230/csi-provisioner Jun 19 06:35:33.143: INFO: creating *v1.ClusterRole: external-provisioner-runner-provisioning-689 Jun 19 06:35:33.143: INFO: Define cluster role external-provisioner-runner-provisioning-689 Jun 19 06:35:33.182: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-provisioning-689 Jun 19 06:35:33.218: INFO: creating *v1.Role: provisioning-689-230/external-provisioner-cfg-provisioning-689 Jun 19 06:35:33.254: INFO: creating *v1.RoleBinding: provisioning-689-230/csi-provisioner-role-cfg Jun 19 06:35:33.291: INFO: creating *v1.ServiceAccount: provisioning-689-230/csi-gce-pd-controller-sa Jun 19 06:35:33.328: INFO: creating *v1.ClusterRole: csi-gce-pd-provisioner-role-provisioning-689 Jun 19 06:35:33.328: INFO: Define cluster role csi-gce-pd-provisioner-role-provisioning-689 Jun 19 06:35:33.365: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-provisioner-binding-provisioning-689 Jun 19 06:35:33.401: INFO: creating *v1.ClusterRole: csi-gce-pd-attacher-role-provisioning-689 Jun 19 06:35:33.401: INFO: Define cluster role csi-gce-pd-attacher-role-provisioning-689 Jun 19 06:35:33.438: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-attacher-binding-provisioning-689 Jun 19 06:35:33.474: INFO: creating *v1.ClusterRole: csi-gce-pd-resizer-role-provisioning-689 Jun 19 06:35:33.474: INFO: Define cluster role csi-gce-pd-resizer-role-provisioning-689 Jun 19 06:35:33.510: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-resizer-binding-provisioning-689 Jun 19 06:35:33.547: INFO: creating *v1.ClusterRole: csi-gce-pd-snapshotter-role-provisioning-689 Jun 19 06:35:33.547: INFO: Define cluster role csi-gce-pd-snapshotter-role-provisioning-689 Jun 19 06:35:33.584: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-snapshotter-binding-provisioning-689 Jun 19 06:35:33.624: INFO: creating *v1.Role: provisioning-689-230/csi-gce-pd-leaderelection-role-provisioning-689 Jun 19 06:35:33.664: INFO: creating *v1.RoleBinding: provisioning-689-230/csi-gce-pd-controller-leaderelection-binding Jun 19 06:35:33.700: INFO: creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-provisioning-689 Jun 19 06:35:33.738: INFO: creating *v1.DaemonSet: provisioning-689-230/csi-gce-pd-node Jun 19 06:35:33.777: INFO: creating *v1.StatefulSet: provisioning-689-230/csi-gce-pd-controller Jun 19 06:35:33.950: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-qcp1 Jun 19 06:35:39.103: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-v98m Jun 19 06:35:39.138: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-vg14 Jun 19 06:35:39.174: INFO: In creating storage class object and pvc objects for driver - sc: &StorageClass{ObjectMeta:{provisioning-689z64p5 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Provisioner:pd.csi.storage.gke.io,Parameters:map[string]string{type: pd-standard,},ReclaimPolicy:nil,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},}, pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-689 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{5368709120 0} {<nil>} 5Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-689z64p5,VolumeMode:*Block,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},}, src-pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-689 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{5368709120 0} {<nil>} 5Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-689z64p5,VolumeMode:*Block,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: Creating a StorageClass �[1mSTEP�[0m: [Initialize dataSource]creating a initClaim �[1mSTEP�[0m: starting gcepd-injector Jun 19 06:35:39.363: INFO: Waiting up to 5m0s for pod "gcepd-injector" in namespace "provisioning-689" to be "running" Jun 19 06:35:39.401: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 38.137314ms Jun 19 06:35:41.438: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.074501951s Jun 19 06:35:43.440: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.076581427s Jun 19 06:35:45.439: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.075892826s Jun 19 06:35:47.439: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.076321031s Jun 19 06:35:49.438: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 10.075082737s Jun 19 06:35:51.439: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 12.075367234s Jun 19 06:35:53.438: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 14.074864721s Jun 19 06:35:55.438: INFO: Pod "gcepd-injector": Phase="Running", Reason="", readiness=true. Elapsed: 16.074557526s Jun 19 06:35:55.438: INFO: Pod "gcepd-injector" satisfied condition "running" �[1mSTEP�[0m: Writing text file contents in the container. Jun 19 06:35:55.438: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.127.118.154 --kubeconfig=/workspace/.kube/config --namespace=provisioning-689 exec gcepd-injector --namespace=provisioning-689 -- /bin/sh -c echo 'Hello from namespace provisioning-689' > /opt/0' Jun 19 06:35:55.937: INFO: stderr: "" Jun 19 06:35:55.937: INFO: stdout: "" �[1mSTEP�[0m: Checking that text file contents are perfect. Jun 19 06:35:55.937: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.127.118.154 --kubeconfig=/workspace/.kube/config --namespace=provisioning-689 exec gcepd-injector --namespace=provisioning-689 -- head -c 37 /opt/0' Jun 19 06:35:56.483: INFO: stderr: "" Jun 19 06:35:56.483: INFO: stdout: "Hello from namespace provisioning-689" Jun 19 06:35:56.483: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:provisioning-689 PodName:gcepd-injector ContainerName:gcepd-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 19 06:35:56.483: INFO: >>> kubeConfig: /workspace/.kube/config Jun 19 06:35:56.487: INFO: ExecWithOptions: Clientset creation Jun 19 06:35:56.487: INFO: ExecWithOptions: execute(POST https://34.127.118.154/api/v1/namespaces/provisioning-689/pods/gcepd-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=gcepd-injector&container=gcepd-injector&stderr=true&stdout=true) Jun 19 06:35:56.768: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:provisioning-689 PodName:gcepd-injector ContainerName:gcepd-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 19 06:35:56.768: INFO: >>> kubeConfig: /workspace/.kube/config Jun 19 06:35:56.770: INFO: ExecWithOptions: Clientset creation Jun 19 06:35:56.770: INFO: ExecWithOptions: execute(POST https://34.127.118.154/api/v1/namespaces/provisioning-689/pods/gcepd-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=gcepd-injector&container=gcepd-injector&stderr=true&stdout=true) �[1mSTEP�[0m: Deleting pod gcepd-injector in namespace provisioning-689 Jun 19 06:35:57.085: INFO: Waiting for pod gcepd-injector to disappear Jun 19 06:35:57.128: INFO: Pod gcepd-injector still exists Jun 19 06:35:59.130: INFO: Waiting for pod gcepd-injector to disappear Jun 19 06:35:59.167: INFO: Pod gcepd-injector still exists Jun 19 06:36:01.131: INFO: Waiting for pod gcepd-injector to disappear Jun 19 06:36:01.169: INFO: Pod gcepd-injector no longer exists �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 19 06:36:01.297: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-ct8hj to become ready Jun 19 06:36:01.345: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:03.382: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:05.418: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:07.456: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:09.493: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:11.529: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:13.566: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:15.606: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:17.643: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:19.680: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:21.716: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:23.753: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:25.790: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:27.826: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:29.862: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:31.900: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:33.937: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:35.974: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:38.012: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:40.049: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:42.086: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:44.124: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:46.162: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:48.201: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:50.238: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:52.276: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:54.314: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:56.353: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:36:58.390: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:00.427: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:02.465: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:04.502: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:06.539: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:08.576: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:10.614: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:12.651: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:14.688: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:16.725: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:18.762: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:20.799: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:22.835: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:24.872: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:26.908: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:28.945: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:30.983: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:33.020: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:35.057: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:37.100: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:39.138: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:41.176: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:43.213: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:45.250: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:47.287: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:49.324: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:51.361: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:53.397: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:55.434: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:57.471: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:37:59.508: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:01.545: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:03.583: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:05.624: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:07.662: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:09.699: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:11.737: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:13.779: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:15.818: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:17.893: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:19.930: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:21.967: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:24.005: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:26.042: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:28.081: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:30.119: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:32.157: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:34.195: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:36.232: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:38.277: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:40.314: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:42.352: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:44.388: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:46.425: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:48.462: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:50.505: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:52.541: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:54.577: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:56.613: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:38:58.650: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:00.687: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:02.725: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:04.762: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:06.800: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:08.836: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:10.872: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:12.910: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:14.947: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:17.029: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:19.067: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:21.105: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:23.142: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:25.178: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:27.215: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:29.254: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:31.291: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:33.329: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:35.365: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:37.401: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:39.438: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:41.475: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:43.512: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:45.549: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:47.586: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:49.632: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:51.670: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:53.707: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:55.750: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:57.788: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:39:59.824: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:01.861: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:03.898: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:05.935: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:07.972: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:10.009: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:12.046: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:14.083: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:16.121: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:18.171: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:20.208: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:22.245: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:24.282: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:26.320: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:28.361: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:30.398: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:32.436: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:34.473: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:36.511: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:38.548: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:40.586: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:42.623: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:44.660: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:46.696: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:48.732: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:50.769: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:52.812: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:54.849: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:56.885: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:40:58.925: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:41:00.963: INFO: VolumeSnapshot snapshot-ct8hj found but is not ready. Jun 19 06:41:02.963: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 19 06:41:02.964: INFO: Unexpected error: <*errors.errorString | 0xc002707660>: { s: "VolumeSnapshot snapshot-ct8hj is not ready within 5m0s", } Jun 19 06:41:02.965: FAIL: VolumeSnapshot snapshot-ct8hj is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc0031058c8?}, 0xc003bca408) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f9d6c166220, 0xc0010c1860}, 0xc0046b5e60, {{0x71975b3, 0x1a}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage/testsuites.prepareSnapshotDataSourceForProvisioning(_, {{0xc0040e3230, 0x10}, {0x7133465, 0x5}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...) test/e2e/storage/testsuites/provisioning.go:1090 +0x41f k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() test/e2e/storage/testsuites/provisioning.go:227 +0x485 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: creating claim=&PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-689 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{5368709120 0} {<nil>} 5Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-689z64p5,VolumeMode:*Block,DataSource:&TypedLocalObjectReference{APIGroup:*snapshot.storage.k8s.io,Kind:VolumeSnapshot,Name:snapshot-ct8hj,},DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: creating a pod referring to the class=&StorageClass{ObjectMeta:{provisioning-689z64p5 c5b3adcb-15ea-4e50-8beb-190aa5b4e4f7 8405 0 2022-06-19 06:35:39 +0000 UTC <nil> <nil> map[] map[] [] [] [{e2e.test Update storage.k8s.io/v1 2022-06-19 06:35:39 +0000 UTC FieldsV1 {"f:parameters":{".":{},"f:type":{}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}} }]},Provisioner:pd.csi.storage.gke.io,Parameters:map[string]string{type: pd-standard,},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},} claim=&PersistentVolumeClaim{ObjectMeta:{pvc-zfxgc pvc- provisioning-689 0556f1e3-bf48-4799-8cae-429ab4a7a8af 9413 0 2022-06-19 06:41:03 +0000 UTC <nil> <nil> map[] map[] [] [kubernetes.io/pvc-protection] [{e2e.test Update v1 2022-06-19 06:41:03 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{}},"f:spec":{"f:accessModes":{},"f:dataSource":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:storageClassName":{},"f:volumeMode":{}}} }]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{5368709120 0} {<nil>} 5Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-689z64p5,VolumeMode:*Block,DataSource:&TypedLocalObjectReference{APIGroup:*snapshot.storage.k8s.io,Kind:VolumeSnapshot,Name:snapshot-ct8hj,},DataSourceRef:&TypedLocalObjectReference{APIGroup:*snapshot.storage.k8s.io,Kind:VolumeSnapshot,Name:snapshot-ct8hj,},},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} Jun 19 06:41:03.223: INFO: Waiting up to 5m0s for pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d" in namespace "provisioning-689" to be "running" Jun 19 06:41:03.321: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 97.604158ms Jun 19 06:41:05.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.148913345s Jun 19 06:41:07.480: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4.256916533s Jun 19 06:41:09.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 6.148100539s Jun 19 06:41:11.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 8.148601899s Jun 19 06:41:13.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 10.147427292s Jun 19 06:41:15.421: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 12.197793986s Jun 19 06:41:17.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 14.148347692s Jun 19 06:41:19.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 16.147231767s Jun 19 06:41:21.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 18.148602391s Jun 19 06:41:23.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 20.148626417s Jun 19 06:41:25.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 22.147438884s Jun 19 06:41:27.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 24.148628286s Jun 19 06:41:29.391: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 26.16756311s Jun 19 06:41:31.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 28.148518222s Jun 19 06:41:33.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 30.148139718s Jun 19 06:41:35.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 32.14818168s Jun 19 06:41:37.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 34.148587374s Jun 19 06:41:39.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 36.147846262s Jun 19 06:41:41.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 38.148061996s Jun 19 06:41:43.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 40.148004888s Jun 19 06:41:45.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 42.147948257s Jun 19 06:41:47.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 44.148023441s Jun 19 06:41:49.373: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 46.150051799s Jun 19 06:41:51.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 48.149077668s Jun 19 06:41:53.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 50.148074971s Jun 19 06:41:55.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 52.147402636s Jun 19 06:41:57.373: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 54.149646229s Jun 19 06:41:59.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 56.147986358s Jun 19 06:42:01.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 58.1486769s Jun 19 06:42:03.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.147448308s Jun 19 06:42:05.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.14753458s Jun 19 06:42:07.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.148595019s Jun 19 06:42:09.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.148371708s Jun 19 06:42:11.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.148661965s Jun 19 06:42:13.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.148528733s Jun 19 06:42:15.358: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.13467466s Jun 19 06:42:17.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.148247733s Jun 19 06:42:19.421: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.197519662s Jun 19 06:42:21.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.147899853s Jun 19 06:42:23.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.148687978s Jun 19 06:42:25.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.148258207s Jun 19 06:42:27.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.14833273s Jun 19 06:42:29.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.147594131s Jun 19 06:42:31.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.148931912s Jun 19 06:42:33.375: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.151107992s Jun 19 06:42:35.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.147946646s Jun 19 06:42:37.373: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.149191586s Jun 19 06:42:39.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.147676876s Jun 19 06:42:41.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.148100709s Jun 19 06:42:43.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.148308912s Jun 19 06:42:45.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.147830754s Jun 19 06:42:47.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.148492275s Jun 19 06:42:49.357: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.133984598s Jun 19 06:42:51.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.14759852s Jun 19 06:42:53.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.147783402s Jun 19 06:42:55.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.148211322s Jun 19 06:42:57.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.148646881s Jun 19 06:42:59.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.148011593s Jun 19 06:43:01.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.148812568s Jun 19 06:43:03.421: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.197989365s Jun 19 06:43:05.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.147793915s Jun 19 06:43:07.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.148827078s Jun 19 06:43:09.373: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.149650845s Jun 19 06:43:11.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.148681494s Jun 19 06:43:13.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.148762602s Jun 19 06:43:15.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.148613273s Jun 19 06:43:17.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.147858751s Jun 19 06:43:19.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.148014258s Jun 19 06:43:21.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.148215605s Jun 19 06:43:23.411: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.18736734s Jun 19 06:43:25.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.148270701s Jun 19 06:43:27.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.147815255s Jun 19 06:43:29.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.148666468s Jun 19 06:43:31.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.148758048s Jun 19 06:43:33.421: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.197904773s Jun 19 06:43:35.370: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.147064019s Jun 19 06:43:37.374: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.150263802s Jun 19 06:43:39.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.148076621s Jun 19 06:43:41.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.147883955s Jun 19 06:43:43.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.147952659s Jun 19 06:43:45.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.148484958s Jun 19 06:43:47.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.147937293s Jun 19 06:43:49.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.147125933s Jun 19 06:43:51.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.148993254s Jun 19 06:43:53.388: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.164294438s Jun 19 06:43:55.421: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.197258771s Jun 19 06:43:57.394: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.170387508s Jun 19 06:43:59.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.148260829s Jun 19 06:44:01.373: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.149193873s Jun 19 06:44:03.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.148390334s Jun 19 06:44:05.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.147606262s Jun 19 06:44:07.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.147908734s Jun 19 06:44:09.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.148026163s Jun 19 06:44:11.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.148577879s Jun 19 06:44:13.375: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.151550533s Jun 19 06:44:15.421: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.198079881s Jun 19 06:44:17.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.148224002s Jun 19 06:44:19.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.147790183s Jun 19 06:44:21.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.148441711s Jun 19 06:44:23.421: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.197614438s Jun 19 06:44:25.422: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.198323217s Jun 19 06:44:27.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.147390289s Jun 19 06:44:29.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.147958239s Jun 19 06:44:31.358: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.134568449s Jun 19 06:44:33.422: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.198468932s Jun 19 06:44:35.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.14763795s Jun 19 06:44:37.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.148378037s Jun 19 06:44:39.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.147872242s Jun 19 06:44:41.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.147346668s Jun 19 06:44:43.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.147461148s Jun 19 06:44:45.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.147863703s Jun 19 06:44:47.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.147868368s Jun 19 06:44:49.421: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.198059856s Jun 19 06:44:51.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.148066693s Jun 19 06:44:53.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.147362878s Jun 19 06:44:55.370: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.147067918s Jun 19 06:44:57.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.147932608s Jun 19 06:44:59.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.147275281s Jun 19 06:45:01.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.148251555s Jun 19 06:45:03.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.148585506s Jun 19 06:45:05.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.147720814s Jun 19 06:45:07.375: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.151740599s Jun 19 06:45:09.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.148099237s Jun 19 06:45:11.376: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.152321773s Jun 19 06:45:13.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.148600494s Jun 19 06:45:15.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.148381188s Jun 19 06:45:17.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.148579574s Jun 19 06:45:19.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.147802436s Jun 19 06:45:21.440: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.216690209s Jun 19 06:45:23.400: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.176200034s Jun 19 06:45:25.374: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.150993354s Jun 19 06:45:27.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.147739759s Jun 19 06:45:29.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.147457459s Jun 19 06:45:31.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.147927484s Jun 19 06:45:33.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.147577785s Jun 19 06:45:35.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.148299097s Jun 19 06:45:37.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.147555547s Jun 19 06:45:39.373: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.149423616s Jun 19 06:45:41.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.147221084s Jun 19 06:45:43.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.147855102s Jun 19 06:45:45.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.148148967s Jun 19 06:45:47.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.147610148s Jun 19 06:45:49.383: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.159949003s Jun 19 06:45:51.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.148500113s Jun 19 06:45:53.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.147620723s Jun 19 06:45:55.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.147458287s Jun 19 06:45:57.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.148769182s Jun 19 06:45:59.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.148501154s Jun 19 06:46:01.371: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.147943398s Jun 19 06:46:03.372: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.148105216s Jun 19 06:46:03.472: INFO: Pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.248152654s Jun 19 06:46:03.472: INFO: Unexpected error: <*errors.errorString | 0xc004375830>: { s: "pod \"pod-83699242-47e1-4d30-8f4c-f9588df1ec6d\" is not Running: timed out while waiting for pod provisioning-689/pod-83699242-47e1-4d30-8f4c-f9588df1ec6d to be running", } Jun 19 06:46:03.472: FAIL: pod "pod-83699242-47e1-4d30-8f4c-f9588df1ec6d" is not Running: timed out while waiting for pod provisioning-689/pod-83699242-47e1-4d30-8f4c-f9588df1ec6d to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.StorageClassTest.TestDynamicProvisioning({{0x7a4f7c8, 0xc003656c00}, 0xc00119c980, 0xc00206a700, 0xc00206a8c0, 0xc004329200, {0x0, 0x0}, {0x0, 0x0, ...}, ...}) test/e2e/storage/testsuites/provisioning.go:631 +0x828 k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() test/e2e/storage/testsuites/provisioning.go:243 +0x618 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f Jun 19 06:46:03.472: INFO: deleting claim "provisioning-689"/"pvc-zfxgc" Jun 19 06:46:03.574: INFO: deleting initClaim "provisioning-689"/"pvc-s8cn2" Jun 19 06:46:03.673: INFO: deleting snapshot "provisioning-689"/"snapshot-ct8hj" Jun 19 06:46:03.709: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 readyToUse:false] Jun 19 06:46:03.709: INFO: snapshotContentName snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 Jun 19 06:46:03.784: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 to be deleted Jun 19 06:46:03.820: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:05.857: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:07.896: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:09.932: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:11.970: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:14.007: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:16.045: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:18.082: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:20.120: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:22.158: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:24.196: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:26.233: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:28.269: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:30.306: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:32.344: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:34.381: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:36.419: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:38.456: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:40.493: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:42.529: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:44.566: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:46.603: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:48.639: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:50.676: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:52.812: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:54.849: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:56.886: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:46:58.925: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:00.962: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:02.999: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:05.036: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:07.074: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:09.110: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:11.147: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:13.184: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:15.224: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:17.261: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:19.299: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:21.335: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:23.375: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 has been found and is not deleted Jun 19 06:47:25.413: INFO: volumesnapshotcontents snapcontent-1559d59f-757c-4140-a097-4b6f1dd699f7 is not found and has been deleted Jun 19 06:47:25.413: INFO: WaitUntil finished successfully after 1m21.628570168s Jun 19 06:47:25.413: INFO: deleting snapshot class "provisioning-689r5px8" Jun 19 06:47:25.451: INFO: Waiting up to 5m0s for volumesnapshotclasses provisioning-689r5px8 to be deleted Jun 19 06:47:25.486: INFO: volumesnapshotclasses provisioning-689r5px8 is not found and has been deleted Jun 19 06:47:25.486: INFO: WaitUntil finished successfully after 34.861991ms Jun 19 06:47:25.486: INFO: deleting storage class provisioning-689z64p5 �[1mSTEP�[0m: deleting the test namespace: provisioning-689 �[1mSTEP�[0m: Waiting for namespaces [provisioning-689] to vanish �[1mSTEP�[0m: uninstalling csi gce-pd driver Jun 19 06:47:31.723: INFO: deleting *v1.ServiceAccount: provisioning-689-230/csi-attacher Jun 19 06:47:31.823: INFO: deleting *v1.ClusterRole: external-attacher-runner-provisioning-689 Jun 19 06:47:31.925: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-provisioning-689 Jun 19 06:47:32.026: INFO: deleting *v1.Role: provisioning-689-230/external-attacher-cfg-provisioning-689 Jun 19 06:47:32.126: INFO: deleting *v1.RoleBinding: provisioning-689-230/csi-attacher-role-cfg Jun 19 06:47:32.287: INFO: deleting *v1.ServiceAccount: provisioning-689-230/csi-provisioner Jun 19 06:47:32.375: INFO: deleting *v1.ClusterRole: external-provisioner-runner-provisioning-689 Jun 19 06:47:32.474: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-provisioning-689 Jun 19 06:47:32.573: INFO: deleting *v1.Role: provisioning-689-230/external-provisioner-cfg-provisioning-689 Jun 19 06:47:32.673: INFO: deleting *v1.RoleBinding: provisioning-689-230/csi-provisioner-role-cfg Jun 19 06:47:32.775: INFO: deleting *v1.ServiceAccount: provisioning-689-230/csi-gce-pd-controller-sa Jun 19 06:47:32.875: INFO: deleting *v1.ClusterRole: csi-gce-pd-provisioner-role-provisioning-689 Jun 19 06:47:32.975: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-provisioner-binding-provisioning-689 Jun 19 06:47:33.074: INFO: deleting *v1.ClusterRole: csi-gce-pd-attacher-role-provisioning-689 Jun 19 06:47:33.173: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-attacher-binding-provisioning-689 Jun 19 06:47:33.273: INFO: deleting *v1.ClusterRole: csi-gce-pd-resizer-role-provisioning-689 Jun 19 06:47:33.373: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-resizer-binding-provisioning-689 Jun 19 06:47:33.473: INFO: deleting *v1.ClusterRole: csi-gce-pd-snapshotter-role-provisioning-689 Jun 19 06:47:33.572: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-snapshotter-binding-provisioning-689 Jun 19 06:47:33.672: INFO: deleting *v1.Role: provisioning-689-230/csi-gce-pd-leaderelection-role-provisioning-689 Jun 19 06:47:33.775: INFO: deleting *v1.RoleBinding: provisioning-689-230/csi-gce-pd-controller-leaderelection-binding Jun 19 06:47:33.875: INFO: deleting *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-provisioning-689 Jun 19 06:47:33.973: INFO: deleting *v1.DaemonSet: provisioning-689-230/csi-gce-pd-node Jun 19 06:47:34.075: INFO: deleting *v1.StatefulSet: provisioning-689-230/csi-gce-pd-controller �[1mSTEP�[0m: deleting the driver namespace: provisioning-689-230 �[1mSTEP�[0m: Waiting for namespaces [provisioning-689-230] to vanish [AfterEach] [Testpattern: Dynamic PV (block volmode)] provisioning test/e2e/framework/framework.go:187 Jun 19 06:47:40.314: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\spd\.csi\.storage\.gke\.io\]\[Serial\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sprovisioning\sshould\sprovision\sstorage\swith\ssnapshot\sdata\ssource\s\[Feature\:VolumeSnapshotDataSource\]$'
test/e2e/storage/testsuites/provisioning.go:208 Jun 19 05:59:55.026: VolumeSnapshot snapshot-p9k28 is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 19 05:54:13.642: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource] test/e2e/storage/testsuites/provisioning.go:208 �[1mSTEP�[0m: deploying csi gce-pd driver �[1mSTEP�[0m: Building a driver namespace object, basename provisioning-40 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace Jun 19 05:54:14.169: INFO: Found CI service account key at /etc/service-account/service-account.json Jun 19 05:54:14.169: INFO: Running cp [/etc/service-account/service-account.json /tmp/b18dae79-deba-47a3-a555-d784f3552d61/cloud-sa.json] Jun 19 05:54:14.209: INFO: Shredding file /tmp/b18dae79-deba-47a3-a555-d784f3552d61/cloud-sa.json Jun 19 05:54:14.209: INFO: Running shred [--remove /tmp/b18dae79-deba-47a3-a555-d784f3552d61/cloud-sa.json] Jun 19 05:54:14.245: INFO: File /tmp/b18dae79-deba-47a3-a555-d784f3552d61/cloud-sa.json successfully shredded Jun 19 05:54:14.252: INFO: creating *v1.ServiceAccount: provisioning-40-1236/csi-attacher Jun 19 05:54:14.289: INFO: creating *v1.ClusterRole: external-attacher-runner-provisioning-40 Jun 19 05:54:14.289: INFO: Define cluster role external-attacher-runner-provisioning-40 Jun 19 05:54:14.331: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-provisioning-40 Jun 19 05:54:14.369: INFO: creating *v1.Role: provisioning-40-1236/external-attacher-cfg-provisioning-40 Jun 19 05:54:14.405: INFO: creating *v1.RoleBinding: provisioning-40-1236/csi-attacher-role-cfg Jun 19 05:54:14.441: INFO: creating *v1.ServiceAccount: provisioning-40-1236/csi-provisioner Jun 19 05:54:14.477: INFO: creating *v1.ClusterRole: external-provisioner-runner-provisioning-40 Jun 19 05:54:14.478: INFO: Define cluster role external-provisioner-runner-provisioning-40 Jun 19 05:54:14.514: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-provisioning-40 Jun 19 05:54:14.550: INFO: creating *v1.Role: provisioning-40-1236/external-provisioner-cfg-provisioning-40 Jun 19 05:54:14.587: INFO: creating *v1.RoleBinding: provisioning-40-1236/csi-provisioner-role-cfg Jun 19 05:54:14.623: INFO: creating *v1.ServiceAccount: provisioning-40-1236/csi-gce-pd-controller-sa Jun 19 05:54:14.660: INFO: creating *v1.ClusterRole: csi-gce-pd-provisioner-role-provisioning-40 Jun 19 05:54:14.660: INFO: Define cluster role csi-gce-pd-provisioner-role-provisioning-40 Jun 19 05:54:14.698: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-provisioner-binding-provisioning-40 Jun 19 05:54:14.735: INFO: creating *v1.ClusterRole: csi-gce-pd-attacher-role-provisioning-40 Jun 19 05:54:14.735: INFO: Define cluster role csi-gce-pd-attacher-role-provisioning-40 Jun 19 05:54:14.771: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-attacher-binding-provisioning-40 Jun 19 05:54:14.807: INFO: creating *v1.ClusterRole: csi-gce-pd-resizer-role-provisioning-40 Jun 19 05:54:14.807: INFO: Define cluster role csi-gce-pd-resizer-role-provisioning-40 Jun 19 05:54:14.845: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-resizer-binding-provisioning-40 Jun 19 05:54:14.881: INFO: creating *v1.ClusterRole: csi-gce-pd-snapshotter-role-provisioning-40 Jun 19 05:54:14.881: INFO: Define cluster role csi-gce-pd-snapshotter-role-provisioning-40 Jun 19 05:54:14.917: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-snapshotter-binding-provisioning-40 Jun 19 05:54:14.954: INFO: creating *v1.Role: provisioning-40-1236/csi-gce-pd-leaderelection-role-provisioning-40 Jun 19 05:54:14.990: INFO: creating *v1.RoleBinding: provisioning-40-1236/csi-gce-pd-controller-leaderelection-binding Jun 19 05:54:15.026: INFO: creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-provisioning-40 Jun 19 05:54:15.063: INFO: creating *v1.DaemonSet: provisioning-40-1236/csi-gce-pd-node Jun 19 05:54:15.102: INFO: creating *v1.StatefulSet: provisioning-40-1236/csi-gce-pd-controller Jun 19 05:54:15.257: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-qcp1 Jun 19 05:54:24.946: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-v98m Jun 19 05:54:27.017: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-vg14 Jun 19 05:54:27.052: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Jun 19 05:54:27.052: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Jun 19 05:54:27.052: INFO: In creating storage class object and pvc objects for driver - sc: &StorageClass{ObjectMeta:{provisioning-40mxsvt 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Provisioner:pd.csi.storage.gke.io,Parameters:map[string]string{type: pd-standard,},ReclaimPolicy:nil,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},}, pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-40 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{5368709120 0} {<nil>} 5Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-40mxsvt,VolumeMode:nil,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},}, src-pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-40 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{5368709120 0} {<nil>} 5Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-40mxsvt,VolumeMode:nil,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: Creating a StorageClass �[1mSTEP�[0m: [Initialize dataSource]creating a initClaim �[1mSTEP�[0m: starting gcepd-injector Jun 19 05:54:27.298: INFO: Waiting up to 5m0s for pod "gcepd-injector" in namespace "provisioning-40" to be "running" Jun 19 05:54:27.337: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 38.962015ms Jun 19 05:54:29.374: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.076179967s Jun 19 05:54:31.373: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.075225165s Jun 19 05:54:33.375: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.076850078s Jun 19 05:54:35.373: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.075024351s Jun 19 05:54:37.374: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 10.076242747s Jun 19 05:54:39.373: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 12.074715321s Jun 19 05:54:41.374: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 14.076109874s Jun 19 05:54:43.374: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 16.075577312s Jun 19 05:54:45.373: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 18.075316165s Jun 19 05:54:47.374: INFO: Pod "gcepd-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 20.075648208s Jun 19 05:54:49.374: INFO: Pod "gcepd-injector": Phase="Running", Reason="", readiness=true. Elapsed: 22.075470371s Jun 19 05:54:49.374: INFO: Pod "gcepd-injector" satisfied condition "running" �[1mSTEP�[0m: Writing text file contents in the container. Jun 19 05:54:49.374: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.127.118.154 --kubeconfig=/workspace/.kube/config --namespace=provisioning-40 exec gcepd-injector --namespace=provisioning-40 -- /bin/sh -c echo 'Hello from namespace provisioning-40' > /opt/0/index.html' Jun 19 05:54:49.909: INFO: stderr: "" Jun 19 05:54:49.909: INFO: stdout: "" �[1mSTEP�[0m: Checking that text file contents are perfect. Jun 19 05:54:49.909: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.127.118.154 --kubeconfig=/workspace/.kube/config --namespace=provisioning-40 exec gcepd-injector --namespace=provisioning-40 -- cat /opt/0/index.html' Jun 19 05:54:50.382: INFO: stderr: "" Jun 19 05:54:50.382: INFO: stdout: "Hello from namespace provisioning-40\n" Jun 19 05:54:50.382: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:provisioning-40 PodName:gcepd-injector ContainerName:gcepd-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 19 05:54:50.382: INFO: >>> kubeConfig: /workspace/.kube/config Jun 19 05:54:50.383: INFO: ExecWithOptions: Clientset creation Jun 19 05:54:50.383: INFO: ExecWithOptions: execute(POST https://34.127.118.154/api/v1/namespaces/provisioning-40/pods/gcepd-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=gcepd-injector&container=gcepd-injector&stderr=true&stdout=true) Jun 19 05:54:50.654: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:provisioning-40 PodName:gcepd-injector ContainerName:gcepd-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 19 05:54:50.654: INFO: >>> kubeConfig: /workspace/.kube/config Jun 19 05:54:50.656: INFO: ExecWithOptions: Clientset creation Jun 19 05:54:50.656: INFO: ExecWithOptions: execute(POST https://34.127.118.154/api/v1/namespaces/provisioning-40/pods/gcepd-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=gcepd-injector&container=gcepd-injector&stderr=true&stdout=true) �[1mSTEP�[0m: Deleting pod gcepd-injector in namespace provisioning-40 Jun 19 05:54:51.054: INFO: Waiting for pod gcepd-injector to disappear Jun 19 05:54:51.090: INFO: Pod gcepd-injector still exists Jun 19 05:54:53.091: INFO: Waiting for pod gcepd-injector to disappear Jun 19 05:54:53.127: INFO: Pod gcepd-injector no longer exists �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 19 05:54:53.243: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-p9k28 to become ready Jun 19 05:54:53.294: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:54:55.362: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:54:57.400: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:54:59.437: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:01.473: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:03.510: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:05.548: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:07.587: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:09.625: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:11.662: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:13.707: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:15.745: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:17.782: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:19.820: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:21.856: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:23.894: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:25.935: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:27.974: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:30.011: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:32.048: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:34.113: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:36.150: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:38.187: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:40.224: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:42.263: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:44.300: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:46.337: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:48.374: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:50.410: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:52.452: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:54.496: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:56.533: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:55:58.571: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:00.607: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:02.644: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:04.681: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:06.718: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:08.759: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:10.795: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:12.832: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:14.868: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:16.904: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:18.940: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:20.977: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:23.014: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:25.051: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:27.088: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:29.125: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:31.162: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:33.200: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:35.306: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:37.344: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:39.380: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:41.417: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:43.455: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:45.492: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:47.530: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:49.567: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:51.605: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:53.642: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:55.679: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:57.718: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:56:59.755: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:01.793: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:03.829: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:05.865: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:07.903: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:09.940: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:11.977: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:14.014: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:16.051: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:18.093: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:20.131: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:22.168: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:24.204: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:26.242: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:28.280: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:30.317: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:32.355: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:34.393: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:36.430: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:38.468: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:40.505: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:42.541: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:44.579: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:46.617: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:48.654: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:50.692: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:52.729: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:54.766: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:56.802: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:57:58.838: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:00.875: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:02.918: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:04.955: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:06.992: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:09.031: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:11.068: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:13.105: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:15.142: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:17.183: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:19.221: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:21.257: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:23.295: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:25.334: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:27.372: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:29.409: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:31.445: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:33.482: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:35.519: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:37.556: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:39.593: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:41.631: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:43.668: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:45.705: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:47.742: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:49.779: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:51.827: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:53.863: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:55.900: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:57.937: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:58:59.974: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:02.012: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:04.049: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:06.088: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:08.123: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:10.160: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:12.198: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:14.242: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:16.279: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:18.315: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:20.351: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:22.464: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:24.500: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:26.538: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:28.575: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:30.611: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:32.649: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:34.686: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:36.724: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:38.763: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:40.799: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:42.837: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:44.874: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:46.911: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:48.950: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:50.988: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:53.025: INFO: VolumeSnapshot snapshot-p9k28 found but is not ready. Jun 19 05:59:55.025: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 19 05:59:55.026: INFO: Unexpected error: <*errors.errorString | 0xc003717680>: { s: "VolumeSnapshot snapshot-p9k28 is not ready within 5m0s", } Jun 19 05:59:55.026: FAIL: VolumeSnapshot snapshot-p9k28 is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc0037f44a8?}, 0xc00195c030) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f9d6c166220, 0xc0010c1860}, 0xc002b3f4a0, {{0x7182fb1, 0x17}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage/testsuites.prepareSnapshotDataSourceForProvisioning(_, {{0xc002fe97e0, 0xf}, {0x7133465, 0x5}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...) test/e2e/storage/testsuites/provisioning.go:1090 +0x41f k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() test/e2e/storage/testsuites/provisioning.go:227 +0x485 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: creating claim=&PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-40 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{5368709120 0} {<nil>} 5Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-40mxsvt,VolumeMode:nil,DataSource:&TypedLocalObjectReference{APIGroup:*snapshot.storage.k8s.io,Kind:VolumeSnapshot,Name:snapshot-p9k28,},DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} �[1mSTEP�[0m: creating a pod referring to the class=&StorageClass{ObjectMeta:{provisioning-40mxsvt 4c0ee0a1-ec73-4f8a-a760-2b37bae6652c 960 0 2022-06-19 05:54:26 +0000 UTC <nil> <nil> map[] map[] [] [] [{e2e.test Update storage.k8s.io/v1 2022-06-19 05:54:26 +0000 UTC FieldsV1 {"f:parameters":{".":{},"f:type":{}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}} }]},Provisioner:pd.csi.storage.gke.io,Parameters:map[string]string{type: pd-standard,},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},} claim=&PersistentVolumeClaim{ObjectMeta:{pvc-nq6kt pvc- provisioning-40 9bf7f42f-1466-4d06-959d-9105e0f8402f 1989 0 2022-06-19 05:59:55 +0000 UTC <nil> <nil> map[] map[] [] [kubernetes.io/pvc-protection] [{e2e.test Update v1 2022-06-19 05:59:55 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{}},"f:spec":{"f:accessModes":{},"f:dataSource":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:storageClassName":{},"f:volumeMode":{}}} }]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{5368709120 0} {<nil>} 5Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-40mxsvt,VolumeMode:*Filesystem,DataSource:&TypedLocalObjectReference{APIGroup:*snapshot.storage.k8s.io,Kind:VolumeSnapshot,Name:snapshot-p9k28,},DataSourceRef:&TypedLocalObjectReference{APIGroup:*snapshot.storage.k8s.io,Kind:VolumeSnapshot,Name:snapshot-p9k28,},},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} Jun 19 05:59:55.144: INFO: Waiting up to 5m0s for pod "pod-575d7228-8829-455d-8344-07cfbf6515c7" in namespace "provisioning-40" to be "running" Jun 19 05:59:55.180: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 36.19467ms Jun 19 05:59:57.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.072997548s Jun 19 05:59:59.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.072511128s Jun 19 06:00:01.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.072918995s Jun 19 06:00:03.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.073199964s Jun 19 06:00:05.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 10.072385845s Jun 19 06:00:07.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 12.073474193s Jun 19 06:00:09.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 14.073315611s Jun 19 06:00:11.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 16.072660597s Jun 19 06:00:13.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 18.07285463s Jun 19 06:00:15.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 20.07208037s Jun 19 06:00:17.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 22.072611613s Jun 19 06:00:19.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 24.072916461s Jun 19 06:00:21.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 26.073349071s Jun 19 06:00:23.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 28.072695734s Jun 19 06:00:25.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 30.073066721s Jun 19 06:00:27.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 32.074248303s Jun 19 06:00:29.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 34.073620135s Jun 19 06:00:31.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 36.073981864s Jun 19 06:00:33.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 38.074434746s Jun 19 06:00:35.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 40.073280964s Jun 19 06:00:37.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 42.073716526s Jun 19 06:00:39.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 44.074311418s Jun 19 06:00:41.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 46.073395322s Jun 19 06:00:43.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 48.072287781s Jun 19 06:00:45.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 50.072670402s Jun 19 06:00:47.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 52.074193037s Jun 19 06:00:49.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 54.073444431s Jun 19 06:00:51.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 56.074223641s Jun 19 06:00:53.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 58.073239456s Jun 19 06:00:55.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.072558462s Jun 19 06:00:57.222: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.078361724s Jun 19 06:00:59.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.072377295s Jun 19 06:01:01.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.073861871s Jun 19 06:01:03.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.072980757s Jun 19 06:01:05.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.072505485s Jun 19 06:01:07.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.07401607s Jun 19 06:01:09.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.074102006s Jun 19 06:01:11.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.073337232s Jun 19 06:01:13.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.073656042s Jun 19 06:01:15.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.073138647s Jun 19 06:01:17.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.072568992s Jun 19 06:01:19.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.07324035s Jun 19 06:01:21.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.073443979s Jun 19 06:01:23.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.073766811s Jun 19 06:01:25.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.073494742s Jun 19 06:01:27.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.074146619s Jun 19 06:01:29.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.072754153s Jun 19 06:01:31.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.073178108s Jun 19 06:01:33.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.073257002s Jun 19 06:01:35.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.073213001s Jun 19 06:01:37.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.073344188s Jun 19 06:01:39.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.074414178s Jun 19 06:01:41.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.073730016s Jun 19 06:01:43.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.073107722s Jun 19 06:01:45.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.072988592s Jun 19 06:01:47.219: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.075139604s Jun 19 06:01:49.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.073737695s Jun 19 06:01:51.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.073947006s Jun 19 06:01:53.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.0737527s Jun 19 06:01:55.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.073185314s Jun 19 06:01:57.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.073354623s Jun 19 06:01:59.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.073217669s Jun 19 06:02:01.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.073777343s Jun 19 06:02:03.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.07321649s Jun 19 06:02:05.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.073221817s Jun 19 06:02:07.219: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.075194672s Jun 19 06:02:09.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.072666494s Jun 19 06:02:11.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.073506562s Jun 19 06:02:13.219: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.075357715s Jun 19 06:02:15.219: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.075251546s Jun 19 06:02:17.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.073887526s Jun 19 06:02:19.236: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.0918522s Jun 19 06:02:21.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.073923311s Jun 19 06:02:23.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.073209214s Jun 19 06:02:25.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.072491527s Jun 19 06:02:27.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.074366458s Jun 19 06:02:29.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.073447693s Jun 19 06:02:31.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.073553963s Jun 19 06:02:33.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.07291135s Jun 19 06:02:35.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.07313903s Jun 19 06:02:37.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.07309287s Jun 19 06:02:39.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.074325465s Jun 19 06:02:41.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.07330049s Jun 19 06:02:43.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.07252637s Jun 19 06:02:45.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.072516244s Jun 19 06:02:47.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.073483359s Jun 19 06:02:49.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.074207107s Jun 19 06:02:51.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.072655562s Jun 19 06:02:53.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.072976842s Jun 19 06:02:55.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.072596074s Jun 19 06:02:57.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.073487883s Jun 19 06:02:59.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.073908382s Jun 19 06:03:01.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.074393981s Jun 19 06:03:03.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.074388143s Jun 19 06:03:05.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.074401324s Jun 19 06:03:07.222: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.078426261s Jun 19 06:03:09.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.074558198s Jun 19 06:03:11.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.074586985s Jun 19 06:03:13.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.073903956s Jun 19 06:03:15.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.074483106s Jun 19 06:03:17.223: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.078743771s Jun 19 06:03:19.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.073261065s Jun 19 06:03:21.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.073321034s Jun 19 06:03:23.223: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.078979326s Jun 19 06:03:25.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.073073834s Jun 19 06:03:27.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.073467441s Jun 19 06:03:29.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.072804279s Jun 19 06:03:31.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.072932902s Jun 19 06:03:33.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.073192853s Jun 19 06:03:35.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.07311842s Jun 19 06:03:37.218: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.073752082s Jun 19 06:03:39.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.072316177s Jun 19 06:03:41.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.073208159s Jun 19 06:03:43.217: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.073610469s Jun 19 06:03:45.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.071993894s Jun 19 06:03:47.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.072635685s Jun 19 06:03:49.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.072046066s Jun 19 06:03:51.262: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.118232357s Jun 19 06:03:53.222: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.078694456s Jun 19 06:03:55.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.072040224s Jun 19 06:03:57.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.072369701s Jun 19 06:03:59.216: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.072252372s Jun 19 06:04:01.265: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.120731274s Jun 19 06:04:03.263: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.119299631s Jun 19 06:04:05.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.120247062s Jun 19 06:04:07.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.120045276s Jun 19 06:04:09.266: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.121991916s Jun 19 06:04:11.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.120108904s Jun 19 06:04:13.263: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.119498537s Jun 19 06:04:15.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.120113594s Jun 19 06:04:17.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.120237213s Jun 19 06:04:19.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.120227124s Jun 19 06:04:21.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.120197266s Jun 19 06:04:23.263: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.119380027s Jun 19 06:04:25.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.120362799s Jun 19 06:04:27.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.119878554s Jun 19 06:04:29.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.119781327s Jun 19 06:04:31.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.119784934s Jun 19 06:04:33.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.119830823s Jun 19 06:04:35.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.120024724s Jun 19 06:04:37.265: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.120958549s Jun 19 06:04:39.263: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.118937099s Jun 19 06:04:41.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.120253447s Jun 19 06:04:43.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.119788629s Jun 19 06:04:45.263: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.118778271s Jun 19 06:04:47.265: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.120833552s Jun 19 06:04:49.263: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.119663182s Jun 19 06:04:51.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.120163861s Jun 19 06:04:53.263: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.119534072s Jun 19 06:04:55.264: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.119751418s Jun 19 06:04:55.365: INFO: Pod "pod-575d7228-8829-455d-8344-07cfbf6515c7": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.22125433s Jun 19 06:04:55.365: INFO: Unexpected error: <*errors.errorString | 0xc0003e5420>: { s: "pod \"pod-575d7228-8829-455d-8344-07cfbf6515c7\" is not Running: timed out while waiting for pod provisioning-40/pod-575d7228-8829-455d-8344-07cfbf6515c7 to be running", } Jun 19 06:04:55.366: FAIL: pod "pod-575d7228-8829-455d-8344-07cfbf6515c7" is not Running: timed out while waiting for pod provisioning-40/pod-575d7228-8829-455d-8344-07cfbf6515c7 to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.StorageClassTest.TestDynamicProvisioning({{0x7a4f7c8, 0xc0011c5c80}, 0xc00119c880, 0xc002b1fa40, 0xc002b1fc00, 0xc003036a80, {0x0, 0x0}, {0x0, 0x0, ...}, ...}) test/e2e/storage/testsuites/provisioning.go:631 +0x828 k8s.io/kubernetes/test/e2e/storage/testsuites.(*provisioningTestSuite).DefineTests.func4() test/e2e/storage/testsuites/provisioning.go:243 +0x618 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f Jun 19 06:04:55.366: INFO: deleting claim "provisioning-40"/"pvc-nq6kt" Jun 19 06:04:55.466: INFO: deleting initClaim "provisioning-40"/"pvc-szgds" Jun 19 06:04:55.566: INFO: deleting snapshot "provisioning-40"/"snapshot-p9k28" Jun 19 06:04:55.601: INFO: received snapshotStatus map[boundVolumeSnapshotContentName:snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 readyToUse:false] Jun 19 06:04:55.602: INFO: snapshotContentName snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 Jun 19 06:04:55.678: INFO: Waiting up to 5m0s for volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 to be deleted Jun 19 06:04:55.718: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:04:57.755: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:04:59.792: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:01.828: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:03.869: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:05.912: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:07.950: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:09.988: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:12.025: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:14.062: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:16.109: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:18.149: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:20.187: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:22.223: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:24.259: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:26.297: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:28.334: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:30.371: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:32.410: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:34.447: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:36.484: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:38.520: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:40.558: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:42.594: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:44.630: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:46.667: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:48.705: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:50.741: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:52.787: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:54.823: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:56.860: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:05:58.897: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:00.934: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:02.972: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:05.010: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:07.046: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:09.083: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:11.121: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:13.158: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:15.195: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:17.231: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:19.267: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:21.304: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:23.340: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:25.377: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:27.417: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:29.454: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:31.492: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:33.529: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:35.568: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:37.604: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:39.641: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:41.678: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:43.722: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:45.759: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:47.796: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:49.833: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:51.869: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:53.906: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:55.942: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:06:57.980: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:00.016: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:02.054: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:04.091: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:06.128: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:08.166: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:10.203: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:12.239: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:14.289: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:16.326: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:18.368: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:20.405: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:22.442: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:24.479: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:26.517: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:28.554: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:30.591: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:32.628: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:34.669: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:36.706: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:38.743: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:40.780: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:42.825: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:44.862: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:46.900: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:48.937: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:50.974: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 has been found and is not deleted Jun 19 06:07:53.012: INFO: volumesnapshotcontents snapcontent-c30fd700-c406-4aa4-a1bd-6e34450c7773 is not found and has been deleted Jun 19 06:07:53.013: INFO: WaitUntil finished successfully after 2m57.334068934s Jun 19 06:07:53.013: INFO: deleting snapshot class "provisioning-409xstn" Jun 19 06:07:53.053: INFO: Waiting up to 5m0s for volumesnapshotclasses provisioning-409xstn to be deleted Jun 19 06:07:53.089: INFO: volumesnapshotclasses provisioning-409xstn is not found and has been deleted Jun 19 06:07:53.090: INFO: WaitUntil finished successfully after 35.872996ms Jun 19 06:07:53.090: INFO: deleting storage class provisioning-40mxsvt �[1mSTEP�[0m: deleting the test namespace: provisioning-40 �[1mSTEP�[0m: Waiting for namespaces [provisioning-40] to vanish �[1mSTEP�[0m: uninstalling csi gce-pd driver Jun 19 06:07:59.364: INFO: deleting *v1.ServiceAccount: provisioning-40-1236/csi-attacher Jun 19 06:07:59.467: INFO: deleting *v1.ClusterRole: external-attacher-runner-provisioning-40 Jun 19 06:07:59.568: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-provisioning-40 Jun 19 06:07:59.666: INFO: deleting *v1.Role: provisioning-40-1236/external-attacher-cfg-provisioning-40 Jun 19 06:07:59.765: INFO: deleting *v1.RoleBinding: provisioning-40-1236/csi-attacher-role-cfg Jun 19 06:07:59.866: INFO: deleting *v1.ServiceAccount: provisioning-40-1236/csi-provisioner Jun 19 06:07:59.965: INFO: deleting *v1.ClusterRole: external-provisioner-runner-provisioning-40 Jun 19 06:08:00.067: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-provisioning-40 Jun 19 06:08:00.167: INFO: deleting *v1.Role: provisioning-40-1236/external-provisioner-cfg-provisioning-40 Jun 19 06:08:00.266: INFO: deleting *v1.RoleBinding: provisioning-40-1236/csi-provisioner-role-cfg Jun 19 06:08:00.366: INFO: deleting *v1.ServiceAccount: provisioning-40-1236/csi-gce-pd-controller-sa Jun 19 06:08:00.466: INFO: deleting *v1.ClusterRole: csi-gce-pd-provisioner-role-provisioning-40 Jun 19 06:08:00.567: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-provisioner-binding-provisioning-40 Jun 19 06:08:00.666: INFO: deleting *v1.ClusterRole: csi-gce-pd-attacher-role-provisioning-40 Jun 19 06:08:00.764: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-attacher-binding-provisioning-40 Jun 19 06:08:00.864: INFO: deleting *v1.ClusterRole: csi-gce-pd-resizer-role-provisioning-40 Jun 19 06:08:00.965: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-resizer-binding-provisioning-40 Jun 19 06:08:01.065: INFO: deleting *v1.ClusterRole: csi-gce-pd-snapshotter-role-provisioning-40 Jun 19 06:08:01.167: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-snapshotter-binding-provisioning-40 Jun 19 06:08:01.265: INFO: deleting *v1.Role: provisioning-40-1236/csi-gce-pd-leaderelection-role-provisioning-40 Jun 19 06:08:01.365: INFO: deleting *v1.RoleBinding: provisioning-40-1236/csi-gce-pd-controller-leaderelection-binding Jun 19 06:08:01.469: INFO: deleting *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-provisioning-40 Jun 19 06:08:01.567: INFO: deleting *v1.DaemonSet: provisioning-40-1236/csi-gce-pd-node Jun 19 06:08:01.667: INFO: deleting *v1.StatefulSet: provisioning-40-1236/csi-gce-pd-controller �[1mSTEP�[0m: deleting the driver namespace: provisioning-40-1236 �[1mSTEP�[0m: Waiting for namespaces [provisioning-40-1236] to vanish [AfterEach] [Testpattern: Dynamic PV (default fs)] provisioning test/e2e/framework/framework.go:187 Jun 19 06:08:07.937: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\spd\.csi\.storage\.gke\.io\]\[Serial\]\s\[Testpattern\:\sDynamic\sSnapshot\s\(retain\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion\s\(persistent\)$'
test/e2e/storage/testsuites/snapshottable.go:278 Jun 19 06:22:42.302: VolumeSnapshot snapshot-tgnnm is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 19 06:17:07.860: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent) test/e2e/storage/testsuites/snapshottable.go:278 �[1mSTEP�[0m: deploying csi gce-pd driver �[1mSTEP�[0m: Building a driver namespace object, basename snapshotting-7578 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace Jun 19 06:17:08.398: INFO: Found CI service account key at /etc/service-account/service-account.json Jun 19 06:17:08.398: INFO: Running cp [/etc/service-account/service-account.json /tmp/48d07499-277c-4275-ad79-60c9b05d08b5/cloud-sa.json] Jun 19 06:17:08.437: INFO: Shredding file /tmp/48d07499-277c-4275-ad79-60c9b05d08b5/cloud-sa.json Jun 19 06:17:08.437: INFO: Running shred [--remove /tmp/48d07499-277c-4275-ad79-60c9b05d08b5/cloud-sa.json] Jun 19 06:17:08.474: INFO: File /tmp/48d07499-277c-4275-ad79-60c9b05d08b5/cloud-sa.json successfully shredded Jun 19 06:17:08.487: INFO: creating *v1.ServiceAccount: snapshotting-7578-2247/csi-attacher Jun 19 06:17:08.542: INFO: creating *v1.ClusterRole: external-attacher-runner-snapshotting-7578 Jun 19 06:17:08.542: INFO: Define cluster role external-attacher-runner-snapshotting-7578 Jun 19 06:17:08.579: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-7578 Jun 19 06:17:08.616: INFO: creating *v1.Role: snapshotting-7578-2247/external-attacher-cfg-snapshotting-7578 Jun 19 06:17:08.653: INFO: creating *v1.RoleBinding: snapshotting-7578-2247/csi-attacher-role-cfg Jun 19 06:17:08.694: INFO: creating *v1.ServiceAccount: snapshotting-7578-2247/csi-provisioner Jun 19 06:17:08.730: INFO: creating *v1.ClusterRole: external-provisioner-runner-snapshotting-7578 Jun 19 06:17:08.730: INFO: Define cluster role external-provisioner-runner-snapshotting-7578 Jun 19 06:17:08.767: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-7578 Jun 19 06:17:08.804: INFO: creating *v1.Role: snapshotting-7578-2247/external-provisioner-cfg-snapshotting-7578 Jun 19 06:17:08.842: INFO: creating *v1.RoleBinding: snapshotting-7578-2247/csi-provisioner-role-cfg Jun 19 06:17:08.878: INFO: creating *v1.ServiceAccount: snapshotting-7578-2247/csi-gce-pd-controller-sa Jun 19 06:17:08.915: INFO: creating *v1.ClusterRole: csi-gce-pd-provisioner-role-snapshotting-7578 Jun 19 06:17:08.915: INFO: Define cluster role csi-gce-pd-provisioner-role-snapshotting-7578 Jun 19 06:17:08.953: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-provisioner-binding-snapshotting-7578 Jun 19 06:17:08.991: INFO: creating *v1.ClusterRole: csi-gce-pd-attacher-role-snapshotting-7578 Jun 19 06:17:08.991: INFO: Define cluster role csi-gce-pd-attacher-role-snapshotting-7578 Jun 19 06:17:09.028: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-attacher-binding-snapshotting-7578 Jun 19 06:17:09.065: INFO: creating *v1.ClusterRole: csi-gce-pd-resizer-role-snapshotting-7578 Jun 19 06:17:09.065: INFO: Define cluster role csi-gce-pd-resizer-role-snapshotting-7578 Jun 19 06:17:09.102: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-resizer-binding-snapshotting-7578 Jun 19 06:17:09.138: INFO: creating *v1.ClusterRole: csi-gce-pd-snapshotter-role-snapshotting-7578 Jun 19 06:17:09.138: INFO: Define cluster role csi-gce-pd-snapshotter-role-snapshotting-7578 Jun 19 06:17:09.175: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-snapshotter-binding-snapshotting-7578 Jun 19 06:17:09.211: INFO: creating *v1.Role: snapshotting-7578-2247/csi-gce-pd-leaderelection-role-snapshotting-7578 Jun 19 06:17:09.249: INFO: creating *v1.RoleBinding: snapshotting-7578-2247/csi-gce-pd-controller-leaderelection-binding Jun 19 06:17:09.285: INFO: creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-snapshotting-7578 Jun 19 06:17:09.325: INFO: creating *v1.DaemonSet: snapshotting-7578-2247/csi-gce-pd-node Jun 19 06:17:09.365: INFO: creating *v1.StatefulSet: snapshotting-7578-2247/csi-gce-pd-controller Jun 19 06:17:09.534: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-qcp1 Jun 19 06:17:11.727: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-v98m Jun 19 06:17:13.800: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-vg14 Jun 19 06:17:13.837: INFO: Creating resource for dynamic PV Jun 19 06:17:13.838: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(pd.csi.storage.gke.io) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-7578l4pcf �[1mSTEP�[0m: creating a claim Jun 19 06:17:13.874: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: [init] starting a pod to use the claim �[1mSTEP�[0m: [init] check pod success Jun 19 06:17:14.024: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-pbd7p" in namespace "snapshotting-7578" to be "Succeeded or Failed" Jun 19 06:17:14.059: INFO: Pod "pvc-snapshottable-tester-pbd7p": Phase="Pending", Reason="", readiness=false. Elapsed: 35.52399ms Jun 19 06:17:16.098: INFO: Pod "pvc-snapshottable-tester-pbd7p": Phase="Pending", Reason="", readiness=false. Elapsed: 2.074445458s Jun 19 06:17:18.101: INFO: Pod "pvc-snapshottable-tester-pbd7p": Phase="Pending", Reason="", readiness=false. Elapsed: 4.076782884s Jun 19 06:17:20.096: INFO: Pod "pvc-snapshottable-tester-pbd7p": Phase="Pending", Reason="", readiness=false. Elapsed: 6.071708987s Jun 19 06:17:22.100: INFO: Pod "pvc-snapshottable-tester-pbd7p": Phase="Pending", Reason="", readiness=false. Elapsed: 8.076141257s Jun 19 06:17:24.096: INFO: Pod "pvc-snapshottable-tester-pbd7p": Phase="Pending", Reason="", readiness=false. Elapsed: 10.072001789s Jun 19 06:17:26.096: INFO: Pod "pvc-snapshottable-tester-pbd7p": Phase="Pending", Reason="", readiness=false. Elapsed: 12.07211517s Jun 19 06:17:28.097: INFO: Pod "pvc-snapshottable-tester-pbd7p": Phase="Pending", Reason="", readiness=false. Elapsed: 14.073008751s Jun 19 06:17:30.096: INFO: Pod "pvc-snapshottable-tester-pbd7p": Phase="Pending", Reason="", readiness=false. Elapsed: 16.072321205s Jun 19 06:17:32.101: INFO: Pod "pvc-snapshottable-tester-pbd7p": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.077133088s �[1mSTEP�[0m: Saw pod success Jun 19 06:17:32.101: INFO: Pod "pvc-snapshottable-tester-pbd7p" satisfied condition "Succeeded or Failed" �[1mSTEP�[0m: [init] checking the claim Jun 19 06:17:32.138: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pd.csi.storage.gke.iostcfd] to have phase Bound Jun 19 06:17:32.174: INFO: PersistentVolumeClaim pd.csi.storage.gke.iostcfd found and phase=Bound (35.887948ms) �[1mSTEP�[0m: [init] checking the PV �[1mSTEP�[0m: [init] deleting the pod Jun 19 06:17:32.310: INFO: Pod pvc-snapshottable-tester-pbd7p has the following logs: Jun 19 06:17:32.310: INFO: Deleting pod "pvc-snapshottable-tester-pbd7p" in namespace "snapshotting-7578" Jun 19 06:17:32.357: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-pbd7p" to be fully deleted �[1mSTEP�[0m: [init] waiting until the node=bootstrap-e2e-minion-group-vg14 is not using the volume=projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/disks/pvc-8bad6e6b-b3fa-469b-a2d0-ca87b744d0c8 Jun 19 06:17:32.430: INFO: current volumes in use: [kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/disks/pvc-8bad6e6b-b3fa-469b-a2d0-ca87b744d0c8] Jun 19 06:17:34.467: INFO: current volumes in use: [kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/disks/pvc-8bad6e6b-b3fa-469b-a2d0-ca87b744d0c8] Jun 19 06:17:36.506: INFO: current volumes in use: [kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/disks/pvc-8bad6e6b-b3fa-469b-a2d0-ca87b744d0c8] Jun 19 06:17:38.544: INFO: current volumes in use: [kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/disks/pvc-8bad6e6b-b3fa-469b-a2d0-ca87b744d0c8] Jun 19 06:17:40.582: INFO: current volumes in use: [] Jun 19 06:17:40.582: INFO: WaitUntil finished successfully after 8.189749337s �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 19 06:17:40.698: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-tgnnm to become ready Jun 19 06:17:40.745: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:17:42.783: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:17:44.819: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:17:46.856: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:17:48.893: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:17:50.931: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:17:52.968: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:17:55.005: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:17:57.043: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:17:59.081: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:01.118: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:03.161: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:05.197: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:07.236: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:09.273: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:11.310: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:13.348: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:15.385: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:17.428: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:19.465: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:21.503: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:23.540: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:25.578: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:27.615: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:29.652: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:31.689: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:33.727: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:35.764: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:37.801: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:39.837: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:41.874: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:43.911: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:45.949: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:47.987: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:50.025: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:52.062: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:54.100: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:56.139: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:18:58.175: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:00.212: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:02.251: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:04.289: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:06.326: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:08.363: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:10.401: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:12.440: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:14.478: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:16.515: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:18.552: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:20.588: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:22.625: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:24.663: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:26.701: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:28.744: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:30.780: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:32.821: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:34.858: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:36.896: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:38.933: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:40.970: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:43.015: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:45.052: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:47.090: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:49.127: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:51.164: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:53.201: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:55.239: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:57.277: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:19:59.314: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:01.351: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:03.392: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:05.429: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:07.468: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:09.503: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:11.541: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:13.578: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:15.622: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:17.659: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:19.695: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:21.731: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:23.768: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:25.805: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:27.842: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:29.879: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:31.924: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:33.960: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:35.996: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:38.035: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:40.072: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:42.110: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:44.147: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:46.184: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:48.221: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:50.258: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:52.296: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:54.333: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:56.372: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:20:58.408: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:00.444: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:02.481: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:04.519: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:06.556: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:08.594: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:10.631: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:12.668: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:14.705: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:16.742: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:18.777: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:20.818: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:22.856: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:24.893: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:26.931: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:28.967: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:31.004: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:33.042: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:35.080: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:37.117: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:39.154: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:41.191: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:43.228: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:45.265: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:47.302: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:49.338: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:51.375: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:53.413: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:55.450: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:57.487: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:21:59.524: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:01.561: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:03.598: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:05.636: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:07.673: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:09.711: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:11.750: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:13.819: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:15.857: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:17.894: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:19.931: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:21.967: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:24.004: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:26.041: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:28.079: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:30.117: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:32.155: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:34.191: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:36.229: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:38.265: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:40.302: INFO: VolumeSnapshot snapshot-tgnnm found but is not ready. Jun 19 06:22:42.302: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 19 06:22:42.302: INFO: Unexpected error: <*errors.errorString | 0xc0019350f0>: { s: "VolumeSnapshot snapshot-tgnnm is not ready within 5m0s", } Jun 19 06:22:42.302: FAIL: VolumeSnapshot snapshot-tgnnm is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc002d88140?}, 0xc0037f43b8) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f9d6c166220, 0xc0010c1860}, 0xc00357d920, {{0x71c3d82, 0x20}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.4.2() test/e2e/storage/testsuites/snapshottable.go:359 +0xb7d k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: checking the snapshot �[1mSTEP�[0m: checking the SnapshotContent �[1mSTEP�[0m: Modifying source data test �[1mSTEP�[0m: modifying the data in the source PVC Jun 19 06:22:42.428: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-data-tester-5qf9j" in namespace "snapshotting-7578" to be "Succeeded or Failed" Jun 19 06:22:42.492: INFO: Pod "pvc-snapshottable-data-tester-5qf9j": Phase="Pending", Reason="", readiness=false. Elapsed: 64.117215ms Jun 19 06:22:44.530: INFO: Pod "pvc-snapshottable-data-tester-5qf9j": Phase="Pending", Reason="", readiness=false. Elapsed: 2.101676605s Jun 19 06:22:46.530: INFO: Pod "pvc-snapshottable-data-tester-5qf9j": Phase="Pending", Reason="", readiness=false. Elapsed: 4.101648646s Jun 19 06:22:48.530: INFO: Pod "pvc-snapshottable-data-tester-5qf9j": Phase="Pending", Reason="", readiness=false. Elapsed: 6.101731005s Jun 19 06:22:50.529: INFO: Pod "pvc-snapshottable-data-tester-5qf9j": Phase="Pending", Reason="", readiness=false. Elapsed: 8.10089114s Jun 19 06:22:52.529: INFO: Pod "pvc-snapshottable-data-tester-5qf9j": Phase="Pending", Reason="", readiness=false. Elapsed: 10.100909682s Jun 19 06:22:54.529: INFO: Pod "pvc-snapshottable-data-tester-5qf9j": Phase="Pending", Reason="", readiness=false. Elapsed: 12.1006409s Jun 19 06:22:56.529: INFO: Pod "pvc-snapshottable-data-tester-5qf9j": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.100645893s �[1mSTEP�[0m: Saw pod success Jun 19 06:22:56.529: INFO: Pod "pvc-snapshottable-data-tester-5qf9j" satisfied condition "Succeeded or Failed" Jun 19 06:22:57.662: INFO: Pod pvc-snapshottable-data-tester-5qf9j has the following logs: Jun 19 06:22:57.662: INFO: Deleting pod "pvc-snapshottable-data-tester-5qf9j" in namespace "snapshotting-7578" Jun 19 06:22:57.716: INFO: Wait up to 5m0s for pod "pvc-snapshottable-data-tester-5qf9j" to be fully deleted �[1mSTEP�[0m: creating a pvc from the snapshot �[1mSTEP�[0m: starting a pod to use the snapshot Jun 19 06:22:57.830: INFO: Waiting up to 15m0s for pod "restored-pvc-tester-j2k2f" in namespace "snapshotting-7578" to be "running" Jun 19 06:22:57.868: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 38.389369ms Jun 19 06:22:59.905: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.07568604s Jun 19 06:23:01.905: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 4.074792765s Jun 19 06:23:03.904: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 6.074536606s Jun 19 06:23:05.905: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 8.075126288s Jun 19 06:23:07.905: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 10.075663099s Jun 19 06:23:09.905: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 12.075220913s Jun 19 06:23:11.904: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 14.074493761s Jun 19 06:23:13.904: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 16.07428063s Jun 19 06:23:15.907: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 18.077493718s Jun 19 06:23:17.905: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 20.075670428s Jun 19 06:23:19.905: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 22.074821679s Jun 19 06:23:21.906: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 24.07578749s Jun 19 06:23:23.905: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 26.075558543s Jun 19 06:23:25.906: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 28.075859926s Jun 19 06:23:27.906: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 30.076358518s Jun 19 06:23:29.904: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Pending", Reason="", readiness=false. Elapsed: 32.074297069s Jun 19 06:23:31.904: INFO: Pod "restored-pvc-tester-j2k2f": Phase="Running", Reason="", readiness=true. Elapsed: 34.074367261s Jun 19 06:23:31.904: INFO: Pod "restored-pvc-tester-j2k2f" satisfied condition "running" Jun 19 06:23:31.904: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.127.118.154 --kubeconfig=/workspace/.kube/config --namespace=snapshotting-7578 exec restored-pvc-tester-j2k2f --namespace=snapshotting-7578 -- cat /mnt/test/data' Jun 19 06:23:32.413: INFO: stderr: "" Jun 19 06:23:32.413: INFO: stdout: "hello from snapshotting-7578 namespace\n" �[1mSTEP�[0m: should delete the VolumeSnapshotContent according to its deletion policy �[1mSTEP�[0m: deleting the snapshot Jun 19 06:23:32.460: INFO: deleting restored pod "snapshotting-7578"/"restored-pvc-tester-j2k2f" Jun 19 06:23:32.503: INFO: deleting restored PVC "snapshotting-7578"/"pvc-mg52h" Jun 19 06:23:32.541: INFO: Waiting up to 5m0s for volumesnapshots snapshotting-7578 to be deleted Jun 19 06:23:32.576: INFO: volumesnapshots snapshotting-7578 is not found in namespace snapshotting-7578 and has been deleted Jun 19 06:23:32.576: INFO: WaitUntil finished successfully after 35.236314ms �[1mSTEP�[0m: checking the SnapshotContent has not been deleted Jun 19 06:23:32.576: INFO: Waiting up to 30s for volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea to be deleted Jun 19 06:23:32.612: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:33.648: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:34.685: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:35.722: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:36.758: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:37.795: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:38.831: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:39.869: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:40.905: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:41.942: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:42.980: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:44.017: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:45.054: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:46.091: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:47.130: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:48.166: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:49.203: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:50.240: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:51.278: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:52.315: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:53.352: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:54.389: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:55.427: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:56.464: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:57.501: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:58.538: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:23:59.575: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:24:00.613: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:24:01.649: INFO: volumesnapshotcontents snapcontent-9d0ad025-81ef-4aef-984f-4a4629bd08ea has been found and is not deleted Jun 19 06:24:02.649: INFO: WaitUntil failed after reaching the timeout 30s [AfterEach] volume snapshot controller test/e2e/storage/testsuites/snapshottable.go:172 Jun 19 06:24:02.689: INFO: Pod restored-pvc-tester-j2k2f has the following logs: Jun 19 06:24:02.689: INFO: Deleting pod "restored-pvc-tester-j2k2f" in namespace "snapshotting-7578" Jun 19 06:24:02.727: INFO: Wait up to 5m0s for pod "restored-pvc-tester-j2k2f" to be fully deleted Jun 19 06:24:06.800: INFO: deleting claim "snapshotting-7578"/"pvc-mg52h" Jun 19 06:24:06.836: INFO: deleting snapshot "snapshotting-7578"/"snapshot-tgnnm" Jun 19 06:24:06.892: INFO: deleting snapshot class "snapshotting-75782ft9j" Jun 19 06:24:06.940: INFO: Waiting up to 5m0s for volumesnapshotclasses snapshotting-75782ft9j to be deleted Jun 19 06:24:06.975: INFO: volumesnapshotclasses snapshotting-75782ft9j is not found and has been deleted Jun 19 06:24:06.975: INFO: WaitUntil finished successfully after 34.799941ms �[1mSTEP�[0m: Deleting pvc Jun 19 06:24:07.049: INFO: Deleting PersistentVolumeClaim "pd.csi.storage.gke.iostcfd" Jun 19 06:24:07.087: INFO: Waiting up to 5m0s for PersistentVolume pvc-8bad6e6b-b3fa-469b-a2d0-ca87b744d0c8 to get deleted Jun 19 06:24:07.146: INFO: PersistentVolume pvc-8bad6e6b-b3fa-469b-a2d0-ca87b744d0c8 found and phase=Bound (59.688791ms) Jun 19 06:24:12.184: INFO: PersistentVolume pvc-8bad6e6b-b3fa-469b-a2d0-ca87b744d0c8 was removed �[1mSTEP�[0m: Deleting sc �[1mSTEP�[0m: deleting the test namespace: snapshotting-7578 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-7578". �[1mSTEP�[0m: Found 27 events. Jun 19 06:24:12.260: INFO: At 2022-06-19 06:17:13 +0000 UTC - event for pd.csi.storage.gke.iostcfd: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jun 19 06:24:12.260: INFO: At 2022-06-19 06:17:13 +0000 UTC - event for pd.csi.storage.gke.iostcfd: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jun 19 06:24:12.260: INFO: At 2022-06-19 06:17:13 +0000 UTC - event for pd.csi.storage.gke.iostcfd: {pd.csi.storage.gke.io_bootstrap-e2e-minion-group-v98m_fdab6c78-7d63-4a83-aaf0-094df8878f17 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-7578/pd.csi.storage.gke.iostcfd" Jun 19 06:24:12.260: INFO: At 2022-06-19 06:17:17 +0000 UTC - event for pd.csi.storage.gke.iostcfd: {pd.csi.storage.gke.io_bootstrap-e2e-minion-group-v98m_fdab6c78-7d63-4a83-aaf0-094df8878f17 } ProvisioningSucceeded: Successfully provisioned volume pvc-8bad6e6b-b3fa-469b-a2d0-ca87b744d0c8 Jun 19 06:24:12.260: INFO: At 2022-06-19 06:17:17 +0000 UTC - event for pvc-snapshottable-tester-pbd7p: {default-scheduler } Scheduled: Successfully assigned snapshotting-7578/pvc-snapshottable-tester-pbd7p to bootstrap-e2e-minion-group-vg14 Jun 19 06:24:12.260: INFO: At 2022-06-19 06:17:27 +0000 UTC - event for pvc-snapshottable-tester-pbd7p: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-8bad6e6b-b3fa-469b-a2d0-ca87b744d0c8" Jun 19 06:24:12.260: INFO: At 2022-06-19 06:17:28 +0000 UTC - event for pvc-snapshottable-tester-pbd7p: {kubelet bootstrap-e2e-minion-group-vg14} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 19 06:24:12.260: INFO: At 2022-06-19 06:17:29 +0000 UTC - event for pvc-snapshottable-tester-pbd7p: {kubelet bootstrap-e2e-minion-group-vg14} Started: Started container volume-tester Jun 19 06:24:12.260: INFO: At 2022-06-19 06:17:29 +0000 UTC - event for pvc-snapshottable-tester-pbd7p: {kubelet bootstrap-e2e-minion-group-vg14} Created: Created container volume-tester Jun 19 06:24:12.260: INFO: At 2022-06-19 06:17:40 +0000 UTC - event for snapshot-tgnnm: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-7578/snapshot-tgnnm to be created by the CSI driver. Jun 19 06:24:12.260: INFO: At 2022-06-19 06:22:42 +0000 UTC - event for pvc-snapshottable-data-tester-5qf9j: {default-scheduler } Scheduled: Successfully assigned snapshotting-7578/pvc-snapshottable-data-tester-5qf9j to bootstrap-e2e-minion-group-vg14 Jun 19 06:24:12.260: INFO: At 2022-06-19 06:22:51 +0000 UTC - event for pvc-snapshottable-data-tester-5qf9j: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-8bad6e6b-b3fa-469b-a2d0-ca87b744d0c8" Jun 19 06:24:12.260: INFO: At 2022-06-19 06:22:51 +0000 UTC - event for snapshot-tgnnm: {snapshot-controller } SnapshotCreated: Snapshot snapshotting-7578/snapshot-tgnnm was successfully created by the CSI driver. Jun 19 06:24:12.260: INFO: At 2022-06-19 06:22:51 +0000 UTC - event for snapshot-tgnnm: {snapshot-controller } SnapshotReady: Snapshot snapshotting-7578/snapshot-tgnnm is ready to use. Jun 19 06:24:12.260: INFO: At 2022-06-19 06:22:53 +0000 UTC - event for pvc-snapshottable-data-tester-5qf9j: {kubelet bootstrap-e2e-minion-group-vg14} Started: Started container volume-tester Jun 19 06:24:12.260: INFO: At 2022-06-19 06:22:53 +0000 UTC - event for pvc-snapshottable-data-tester-5qf9j: {kubelet bootstrap-e2e-minion-group-vg14} Created: Created container volume-tester Jun 19 06:24:12.260: INFO: At 2022-06-19 06:22:53 +0000 UTC - event for pvc-snapshottable-data-tester-5qf9j: {kubelet bootstrap-e2e-minion-group-vg14} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 19 06:24:12.260: INFO: At 2022-06-19 06:22:57 +0000 UTC - event for pvc-mg52h: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jun 19 06:24:12.260: INFO: At 2022-06-19 06:22:57 +0000 UTC - event for pvc-mg52h: {pd.csi.storage.gke.io_bootstrap-e2e-minion-group-v98m_fdab6c78-7d63-4a83-aaf0-094df8878f17 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-7578/pvc-mg52h" Jun 19 06:24:12.260: INFO: At 2022-06-19 06:22:57 +0000 UTC - event for pvc-mg52h: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jun 19 06:24:12.260: INFO: At 2022-06-19 06:23:19 +0000 UTC - event for pvc-mg52h: {pd.csi.storage.gke.io_bootstrap-e2e-minion-group-v98m_fdab6c78-7d63-4a83-aaf0-094df8878f17 } ProvisioningSucceeded: Successfully provisioned volume pvc-b3139ed5-b640-408b-a741-8a543be5863c Jun 19 06:24:12.260: INFO: At 2022-06-19 06:23:19 +0000 UTC - event for restored-pvc-tester-j2k2f: {default-scheduler } Scheduled: Successfully assigned snapshotting-7578/restored-pvc-tester-j2k2f to bootstrap-e2e-minion-group-vg14 Jun 19 06:24:12.260: INFO: At 2022-06-19 06:23:29 +0000 UTC - event for restored-pvc-tester-j2k2f: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-b3139ed5-b640-408b-a741-8a543be5863c" Jun 19 06:24:12.260: INFO: At 2022-06-19 06:23:30 +0000 UTC - event for restored-pvc-tester-j2k2f: {kubelet bootstrap-e2e-minion-group-vg14} Created: Created container volume-tester Jun 19 06:24:12.260: INFO: At 2022-06-19 06:23:30 +0000 UTC - event for restored-pvc-tester-j2k2f: {kubelet bootstrap-e2e-minion-group-vg14} Started: Started container volume-tester Jun 19 06:24:12.260: INFO: At 2022-06-19 06:23:30 +0000 UTC - event for restored-pvc-tester-j2k2f: {kubelet bootstrap-e2e-minion-group-vg14} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 19 06:24:12.260: INFO: At 2022-06-19 06:23:33 +0000 UTC - event for restored-pvc-tester-j2k2f: {kubelet bootstrap-e2e-minion-group-vg14} Killing: Stopping container volume-tester Jun 19 06:24:12.296: INFO: POD NODE PHASE GRACE CONDITIONS Jun 19 06:24:12.296: INFO: Jun 19 06:24:12.333: INFO: Logging node info for node bootstrap-e2e-master Jun 19 06:24:12.369: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master b70a79b4-f34d-45f8-938e-6f3b3224ddac 5368 0 2022-06-19 05:52:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/instances/bootstrap-e2e-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:20:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:20:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.127.118.154,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d48293e9fabdc7ca70d161b06af3da10,SystemUUID:d48293e9-fabd-c7ca-70d1-61b06af3da10,BootID:0f6cfa59-e1ee-4de4-bf6f-4e1f12698e99,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:117361473,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:24:12.369: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 19 06:24:12.410: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 19 06:24:12.489: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.489: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 19 06:24:12.489: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.489: INFO: Container kube-scheduler ready: true, restart count 0 Jun 19 06:24:12.489: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-19 05:51:08 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.489: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 19 06:24:12.489: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.489: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 19 06:24:12.489: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.489: INFO: Container kube-apiserver ready: true, restart count 0 Jun 19 06:24:12.489: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.489: INFO: Container etcd-container ready: true, restart count 0 Jun 19 06:24:12.489: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.489: INFO: Container etcd-container ready: true, restart count 0 Jun 19 06:24:12.489: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.489: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 19 06:24:12.489: INFO: metadata-proxy-v0.1-dftl5 started at 2022-06-19 05:52:34 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:12.489: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:24:12.489: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:24:12.489: INFO: csi-gce-pd-node-pgd4j started at 2022-06-19 06:17:09 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:12.489: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 19 06:24:12.489: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 19 06:24:12.686: INFO: Latency metrics for node bootstrap-e2e-master Jun 19 06:24:12.686: INFO: Logging node info for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:24:12.724: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qcp1 f578c18d-9d7d-4046-a3c5-035049291f46 5782 0 2022-06-19 05:52:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qcp1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/instances/bootstrap-e2e-minion-group-qcp1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:20:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 06:22:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-qcp1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821426688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559282688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:03 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:03 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:03 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:20:03 +0000 UTC,LastTransitionTime:2022-06-19 05:52:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.199.146.124,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23ad93bfd15643880ef5ec43ad77f973,SystemUUID:23ad93bf-d156-4388-0ef5-ec43ad77f973,BootID:7ac23b1d-549e-44ef-9eaa-3dbb749ded08,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:24:12.724: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:24:12.764: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qcp1 Jun 19 06:24:12.857: INFO: coredns-85bc9d67b-hzkc7 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.857: INFO: Container coredns ready: true, restart count 0 Jun 19 06:24:12.857: INFO: volume-snapshot-controller-0 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.857: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 19 06:24:12.857: INFO: kube-dns-autoscaler-5477bd659c-plscr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.857: INFO: Container autoscaler ready: true, restart count 0 Jun 19 06:24:12.857: INFO: l7-default-backend-5f6f9745f9-7t4pf started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.857: INFO: Container default-http-backend ready: true, restart count 0 Jun 19 06:24:12.857: INFO: konnectivity-agent-z92tr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.857: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:24:12.857: INFO: kube-proxy-bootstrap-e2e-minion-group-qcp1 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:12.857: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:24:12.857: INFO: metadata-proxy-v0.1-8p6rv started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:12.857: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:24:12.857: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:24:12.857: INFO: csi-gce-pd-node-tcb6z started at 2022-06-19 06:17:09 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:12.857: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 19 06:24:12.857: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 19 06:24:13.033: INFO: Latency metrics for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:24:13.033: INFO: Logging node info for node bootstrap-e2e-minion-group-v98m Jun 19 06:24:13.072: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-v98m 75fa2a8c-51fd-4106-aa37-3a44a456bdf3 5783 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-v98m kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/instances/bootstrap-e2e-minion-group-v98m"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:20:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 06:22:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-v98m,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:31 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:31 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:31 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:20:31 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.168.72.251,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:471d705f22032fce16758d01e419fd6f,SystemUUID:471d705f-2203-2fce-1675-8d01e419fd6f,BootID:1ec48621-6cc9-4851-bac7-4039e6e09109,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:dc0301d9a43e23e389abb7690cd631f98af76ea3429259c7f5f643fd31fc0a3e registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0],SizeBytes:27914152,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:24:13.072: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-v98m Jun 19 06:24:13.110: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-v98m Jun 19 06:24:13.184: INFO: csi-gce-pd-controller-0 started at 2022-06-19 06:17:09 +0000 UTC (0+5 container statuses recorded) Jun 19 06:24:13.184: INFO: Container csi-attacher ready: true, restart count 0 Jun 19 06:24:13.184: INFO: Container csi-provisioner ready: true, restart count 0 Jun 19 06:24:13.184: INFO: Container csi-resizer ready: true, restart count 0 Jun 19 06:24:13.184: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 19 06:24:13.184: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 19 06:24:13.184: INFO: kube-proxy-bootstrap-e2e-minion-group-v98m started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:13.184: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:24:13.184: INFO: metadata-proxy-v0.1-spzmg started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:13.184: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:24:13.184: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:24:13.184: INFO: konnectivity-agent-87hwr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:13.184: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:24:13.184: INFO: metrics-server-v0.5.2-755d66fb57-jtgcf started at 2022-06-19 05:53:00 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:13.184: INFO: Container metrics-server ready: true, restart count 0 Jun 19 06:24:13.184: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 19 06:24:13.184: INFO: csi-gce-pd-node-jj2rd started at 2022-06-19 06:17:09 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:13.184: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 19 06:24:13.184: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 19 06:24:13.364: INFO: Latency metrics for node bootstrap-e2e-minion-group-v98m Jun 19 06:24:13.364: INFO: Logging node info for node bootstrap-e2e-minion-group-vg14 Jun 19 06:24:13.402: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-vg14 1d72ee75-4603-4a55-b2e8-270e62899bc0 6079 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-vg14 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-vg14 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/instances/bootstrap-e2e-minion-group-vg14"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-19 06:22:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-19 06:23:29 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:24:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-vg14,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:24:06 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:24:06 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:24:06 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:24:06 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.23.69,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39085846033450b547007ba5da404b34,SystemUUID:39085846-0334-50b5-4700-7ba5da404b34,BootID:9d0a40ab-cad4-4158-bdf2-064a38204d74,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:24:13.402: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-vg14 Jun 19 06:24:13.440: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-vg14 Jun 19 06:24:13.483: INFO: kube-proxy-bootstrap-e2e-minion-group-vg14 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:13.483: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:24:13.483: INFO: metadata-proxy-v0.1-p2ll4 started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:13.483: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:24:13.483: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:24:13.483: INFO: konnectivity-agent-8srbc started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:13.483: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:24:13.483: INFO: coredns-85bc9d67b-rdq7m started at 2022-06-19 05:52:52 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:13.483: INFO: Container coredns ready: true, restart count 0 Jun 19 06:24:13.483: INFO: csi-gce-pd-node-wt6jm started at 2022-06-19 06:17:09 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:13.483: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 19 06:24:13.483: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 19 06:24:13.649: INFO: Latency metrics for node bootstrap-e2e-minion-group-vg14 �[1mSTEP�[0m: Waiting for namespaces [snapshotting-7578] to vanish �[1mSTEP�[0m: uninstalling csi gce-pd driver Jun 19 06:24:19.724: INFO: deleting *v1.ServiceAccount: snapshotting-7578-2247/csi-attacher Jun 19 06:24:19.762: INFO: deleting *v1.ClusterRole: external-attacher-runner-snapshotting-7578 Jun 19 06:24:19.799: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-7578 Jun 19 06:24:19.835: INFO: deleting *v1.Role: snapshotting-7578-2247/external-attacher-cfg-snapshotting-7578 Jun 19 06:24:19.872: INFO: deleting *v1.RoleBinding: snapshotting-7578-2247/csi-attacher-role-cfg Jun 19 06:24:19.910: INFO: deleting *v1.ServiceAccount: snapshotting-7578-2247/csi-provisioner Jun 19 06:24:19.948: INFO: deleting *v1.ClusterRole: external-provisioner-runner-snapshotting-7578 Jun 19 06:24:19.991: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-7578 Jun 19 06:24:20.028: INFO: deleting *v1.Role: snapshotting-7578-2247/external-provisioner-cfg-snapshotting-7578 Jun 19 06:24:20.067: INFO: deleting *v1.RoleBinding: snapshotting-7578-2247/csi-provisioner-role-cfg Jun 19 06:24:20.104: INFO: deleting *v1.ServiceAccount: snapshotting-7578-2247/csi-gce-pd-controller-sa Jun 19 06:24:20.141: INFO: deleting *v1.ClusterRole: csi-gce-pd-provisioner-role-snapshotting-7578 Jun 19 06:24:20.179: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-provisioner-binding-snapshotting-7578 Jun 19 06:24:20.216: INFO: deleting *v1.ClusterRole: csi-gce-pd-attacher-role-snapshotting-7578 Jun 19 06:24:20.253: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-attacher-binding-snapshotting-7578 Jun 19 06:24:20.290: INFO: deleting *v1.ClusterRole: csi-gce-pd-resizer-role-snapshotting-7578 Jun 19 06:24:20.327: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-resizer-binding-snapshotting-7578 Jun 19 06:24:20.364: INFO: deleting *v1.ClusterRole: csi-gce-pd-snapshotter-role-snapshotting-7578 Jun 19 06:24:20.400: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-snapshotter-binding-snapshotting-7578 Jun 19 06:24:20.437: INFO: deleting *v1.Role: snapshotting-7578-2247/csi-gce-pd-leaderelection-role-snapshotting-7578 Jun 19 06:24:20.475: INFO: deleting *v1.RoleBinding: snapshotting-7578-2247/csi-gce-pd-controller-leaderelection-binding Jun 19 06:24:20.511: INFO: deleting *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-snapshotting-7578 Jun 19 06:24:20.548: INFO: deleting *v1.DaemonSet: snapshotting-7578-2247/csi-gce-pd-node Jun 19 06:24:20.586: INFO: deleting *v1.StatefulSet: snapshotting-7578-2247/csi-gce-pd-controller �[1mSTEP�[0m: deleting the driver namespace: snapshotting-7578-2247 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-7578-2247". �[1mSTEP�[0m: Found 56 events. Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:09 +0000 UTC - event for csi-gce-pd-controller: {statefulset-controller } SuccessfulCreate: create Pod csi-gce-pd-controller-0 in StatefulSet csi-gce-pd-controller successful Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:09 +0000 UTC - event for csi-gce-pd-controller-0: {default-scheduler } Scheduled: Successfully assigned snapshotting-7578-2247/csi-gce-pd-controller-0 to bootstrap-e2e-minion-group-v98m Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:09 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-pgd4j Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:09 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-tcb6z Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:09 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-jj2rd Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:09 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-wt6jm Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:09 +0000 UTC - event for csi-gce-pd-node-jj2rd: {default-scheduler } Scheduled: Successfully assigned snapshotting-7578-2247/csi-gce-pd-node-jj2rd to bootstrap-e2e-minion-group-v98m Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:09 +0000 UTC - event for csi-gce-pd-node-pgd4j: {default-scheduler } Scheduled: Successfully assigned snapshotting-7578-2247/csi-gce-pd-node-pgd4j to bootstrap-e2e-master Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:09 +0000 UTC - event for csi-gce-pd-node-tcb6z: {default-scheduler } Scheduled: Successfully assigned snapshotting-7578-2247/csi-gce-pd-node-tcb6z to bootstrap-e2e-minion-group-qcp1 Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:09 +0000 UTC - event for csi-gce-pd-node-wt6jm: {default-scheduler } Scheduled: Successfully assigned snapshotting-7578-2247/csi-gce-pd-node-wt6jm to bootstrap-e2e-minion-group-vg14 Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:09 +0000 UTC - event for csi-gce-pd-node-wt6jm: {kubelet bootstrap-e2e-minion-group-vg14} Pulled: Container image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} FailedMount: MountVolume.SetUp failed for volume "cloud-sa-volume" : failed to sync secret cache: timed out waiting for the condition Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-jj2rd: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container gce-pd-driver Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-jj2rd: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-jj2rd: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-jj2rd: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-driver-registrar Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-jj2rd: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container gce-pd-driver Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-jj2rd: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-driver-registrar Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-pgd4j: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-pgd4j: {kubelet bootstrap-e2e-master} Started: Started container csi-driver-registrar Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-pgd4j: {kubelet bootstrap-e2e-master} Created: Created container gce-pd-driver Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-pgd4j: {kubelet bootstrap-e2e-master} Started: Started container gce-pd-driver Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-pgd4j: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-pgd4j: {kubelet bootstrap-e2e-master} Created: Created container csi-driver-registrar Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-tcb6z: {kubelet bootstrap-e2e-minion-group-qcp1} Started: Started container csi-driver-registrar Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-tcb6z: {kubelet bootstrap-e2e-minion-group-qcp1} Started: Started container gce-pd-driver Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-tcb6z: {kubelet bootstrap-e2e-minion-group-qcp1} Created: Created container gce-pd-driver Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-tcb6z: {kubelet bootstrap-e2e-minion-group-qcp1} Pulled: Container image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-tcb6z: {kubelet bootstrap-e2e-minion-group-qcp1} Pulled: Container image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-tcb6z: {kubelet bootstrap-e2e-minion-group-qcp1} Created: Created container csi-driver-registrar Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-wt6jm: {kubelet bootstrap-e2e-minion-group-vg14} Started: Started container gce-pd-driver Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-wt6jm: {kubelet bootstrap-e2e-minion-group-vg14} Created: Created container gce-pd-driver Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-wt6jm: {kubelet bootstrap-e2e-minion-group-vg14} Pulled: Container image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-wt6jm: {kubelet bootstrap-e2e-minion-group-vg14} Started: Started container csi-driver-registrar Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:10 +0000 UTC - event for csi-gce-pd-node-wt6jm: {kubelet bootstrap-e2e-minion-group-vg14} Created: Created container csi-driver-registrar Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:11 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1" Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container gce-pd-driver Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-provisioner Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-attacher:v3.4.0" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-attacher Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-snapshotter Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-attacher Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-resizer:v1.4.0" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-resizer Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-resizer Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container gce-pd-driver Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1" in 220.289165ms Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-provisioner:v3.1.0" already present on machine Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-snapshotter Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:12 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-provisioner Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:13 +0000 UTC - event for external-attacher-leader-pd-csi-storage-gke-io: {external-attacher-leader-pd.csi.storage.gke.io/bootstrap-e2e-minion-group-v98m } LeaderElection: bootstrap-e2e-minion-group-v98m became leader Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:13 +0000 UTC - event for external-resizer-pd-csi-storage-gke-io: {external-resizer-pd-csi-storage-gke-io/bootstrap-e2e-minion-group-v98m } LeaderElection: bootstrap-e2e-minion-group-v98m became leader Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:13 +0000 UTC - event for external-snapshotter-leader-pd-csi-storage-gke-io: {external-snapshotter-leader-pd.csi.storage.gke.io/bootstrap-e2e-minion-group-v98m } LeaderElection: bootstrap-e2e-minion-group-v98m became leader Jun 19 06:24:20.734: INFO: At 2022-06-19 06:17:13 +0000 UTC - event for pd-csi-storage-gke-io: {pd.csi.storage.gke.io/bootstrap-e2e-minion-group-v98m } LeaderElection: bootstrap-e2e-minion-group-v98m became leader Jun 19 06:24:20.734: INFO: At 2022-06-19 06:24:20 +0000 UTC - event for csi-gce-pd-node-wt6jm: {kubelet bootstrap-e2e-minion-group-vg14} Killing: Stopping container csi-driver-registrar Jun 19 06:24:20.772: INFO: POD NODE PHASE GRACE CONDITIONS Jun 19 06:24:20.772: INFO: csi-gce-pd-controller-0 bootstrap-e2e-minion-group-v98m Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:09 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:13 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:13 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:09 +0000 UTC }] Jun 19 06:24:20.772: INFO: csi-gce-pd-node-jj2rd bootstrap-e2e-minion-group-v98m Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:09 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:11 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:11 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:09 +0000 UTC }] Jun 19 06:24:20.772: INFO: csi-gce-pd-node-pgd4j bootstrap-e2e-master Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:09 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:11 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:11 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:09 +0000 UTC }] Jun 19 06:24:20.772: INFO: csi-gce-pd-node-tcb6z bootstrap-e2e-minion-group-qcp1 Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:09 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:10 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:10 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:09 +0000 UTC }] Jun 19 06:24:20.772: INFO: csi-gce-pd-node-wt6jm bootstrap-e2e-minion-group-vg14 Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:09 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:10 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:10 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:17:09 +0000 UTC }] Jun 19 06:24:20.772: INFO: Jun 19 06:24:21.613: INFO: Logging node info for node bootstrap-e2e-master Jun 19 06:24:21.650: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master b70a79b4-f34d-45f8-938e-6f3b3224ddac 6171 0 2022-06-19 05:52:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:20:10 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:20:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.127.118.154,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d48293e9fabdc7ca70d161b06af3da10,SystemUUID:d48293e9-fabd-c7ca-70d1-61b06af3da10,BootID:0f6cfa59-e1ee-4de4-bf6f-4e1f12698e99,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:117361473,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:24:21.650: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 19 06:24:21.688: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 19 06:24:21.731: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:21.731: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 19 06:24:21.731: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:21.732: INFO: Container kube-scheduler ready: true, restart count 0 Jun 19 06:24:21.732: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-19 05:51:08 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:21.732: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 19 06:24:21.732: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:21.732: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 19 06:24:21.732: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:21.732: INFO: Container kube-apiserver ready: true, restart count 0 Jun 19 06:24:21.732: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:21.732: INFO: Container etcd-container ready: true, restart count 0 Jun 19 06:24:21.732: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:21.732: INFO: Container etcd-container ready: true, restart count 0 Jun 19 06:24:21.732: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:21.732: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 19 06:24:21.732: INFO: metadata-proxy-v0.1-dftl5 started at 2022-06-19 05:52:34 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:21.732: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:24:21.732: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:24:21.961: INFO: Latency metrics for node bootstrap-e2e-master Jun 19 06:24:21.961: INFO: Logging node info for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:24:21.998: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qcp1 f578c18d-9d7d-4046-a3c5-035049291f46 6169 0 2022-06-19 05:52:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qcp1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:20:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 06:22:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-qcp1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821426688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559282688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:03 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:03 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:03 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:20:03 +0000 UTC,LastTransitionTime:2022-06-19 05:52:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.199.146.124,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23ad93bfd15643880ef5ec43ad77f973,SystemUUID:23ad93bf-d156-4388-0ef5-ec43ad77f973,BootID:7ac23b1d-549e-44ef-9eaa-3dbb749ded08,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:24:21.998: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:24:22.037: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qcp1 Jun 19 06:24:22.086: INFO: kube-dns-autoscaler-5477bd659c-plscr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:22.087: INFO: Container autoscaler ready: true, restart count 0 Jun 19 06:24:22.087: INFO: l7-default-backend-5f6f9745f9-7t4pf started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:22.087: INFO: Container default-http-backend ready: true, restart count 0 Jun 19 06:24:22.087: INFO: konnectivity-agent-z92tr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:22.087: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:24:22.087: INFO: kube-proxy-bootstrap-e2e-minion-group-qcp1 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:22.087: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:24:22.087: INFO: metadata-proxy-v0.1-8p6rv started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:22.087: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:24:22.087: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:24:22.087: INFO: coredns-85bc9d67b-hzkc7 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:22.087: INFO: Container coredns ready: true, restart count 0 Jun 19 06:24:22.087: INFO: volume-snapshot-controller-0 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:22.087: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 19 06:24:22.272: INFO: Latency metrics for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:24:22.273: INFO: Logging node info for node bootstrap-e2e-minion-group-v98m Jun 19 06:24:22.309: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-v98m 75fa2a8c-51fd-4106-aa37-3a44a456bdf3 6174 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-v98m kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:20:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 06:22:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-v98m,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:22:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:31 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:31 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:20:31 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:20:31 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.168.72.251,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:471d705f22032fce16758d01e419fd6f,SystemUUID:471d705f-2203-2fce-1675-8d01e419fd6f,BootID:1ec48621-6cc9-4851-bac7-4039e6e09109,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:dc0301d9a43e23e389abb7690cd631f98af76ea3429259c7f5f643fd31fc0a3e registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0],SizeBytes:27914152,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:24:22.310: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-v98m Jun 19 06:24:22.349: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-v98m Jun 19 06:24:22.394: INFO: kube-proxy-bootstrap-e2e-minion-group-v98m started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:22.394: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:24:22.394: INFO: metadata-proxy-v0.1-spzmg started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:22.394: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:24:22.394: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:24:22.394: INFO: konnectivity-agent-87hwr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:22.394: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:24:22.394: INFO: metrics-server-v0.5.2-755d66fb57-jtgcf started at 2022-06-19 05:53:00 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:22.394: INFO: Container metrics-server ready: true, restart count 0 Jun 19 06:24:22.394: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 19 06:24:22.555: INFO: Latency metrics for node bootstrap-e2e-minion-group-v98m Jun 19 06:24:22.555: INFO: Logging node info for node bootstrap-e2e-minion-group-vg14 Jun 19 06:24:22.592: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-vg14 1d72ee75-4603-4a55-b2e8-270e62899bc0 6176 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-vg14 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-vg14 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-19 06:22:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-19 06:23:29 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:24:06 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-vg14,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:22:36 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:24:06 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:24:06 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:24:06 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:24:06 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.23.69,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39085846033450b547007ba5da404b34,SystemUUID:39085846-0334-50b5-4700-7ba5da404b34,BootID:9d0a40ab-cad4-4158-bdf2-064a38204d74,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:24:22.592: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-vg14 Jun 19 06:24:22.631: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-vg14 Jun 19 06:24:22.673: INFO: kube-proxy-bootstrap-e2e-minion-group-vg14 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:22.674: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:24:22.674: INFO: metadata-proxy-v0.1-p2ll4 started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:24:22.674: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:24:22.674: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:24:22.674: INFO: konnectivity-agent-8srbc started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:22.674: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:24:22.674: INFO: coredns-85bc9d67b-rdq7m started at 2022-06-19 05:52:52 +0000 UTC (0+1 container statuses recorded) Jun 19 06:24:22.674: INFO: Container coredns ready: true, restart count 0 Jun 19 06:24:22.837: INFO: Latency metrics for node bootstrap-e2e-minion-group-vg14 �[1mSTEP�[0m: Waiting for namespaces [snapshotting-7578-2247] to vanish [AfterEach] [Testpattern: Dynamic Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:187 Jun 19 06:24:28.916: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\spd\.csi\.storage\.gke\.io\]\[Serial\]\s\[Testpattern\:\sPre\-provisioned\sSnapshot\s\(retain\spolicy\)\]\ssnapshottable\[Feature\:VolumeSnapshotDataSource\]\svolume\ssnapshot\scontroller\s\sshould\scheck\ssnapshot\sfields\,\scheck\srestore\scorrectly\sworks\safter\smodifying\ssource\sdata\,\scheck\sdeletion\s\(persistent\)$'
test/e2e/storage/testsuites/snapshottable.go:278 Jun 19 06:30:02.391: VolumeSnapshot snapshot-sh2sx is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 19 06:24:28.954: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename snapshotting �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent) test/e2e/storage/testsuites/snapshottable.go:278 �[1mSTEP�[0m: deploying csi gce-pd driver �[1mSTEP�[0m: Building a driver namespace object, basename snapshotting-3870 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace Jun 19 06:24:29.480: INFO: Found CI service account key at /etc/service-account/service-account.json Jun 19 06:24:29.480: INFO: Running cp [/etc/service-account/service-account.json /tmp/3230f218-a29e-4938-bb89-87580a800a2f/cloud-sa.json] Jun 19 06:24:29.519: INFO: Shredding file /tmp/3230f218-a29e-4938-bb89-87580a800a2f/cloud-sa.json Jun 19 06:24:29.519: INFO: Running shred [--remove /tmp/3230f218-a29e-4938-bb89-87580a800a2f/cloud-sa.json] Jun 19 06:24:29.565: INFO: File /tmp/3230f218-a29e-4938-bb89-87580a800a2f/cloud-sa.json successfully shredded Jun 19 06:24:29.574: INFO: creating *v1.ServiceAccount: snapshotting-3870-4513/csi-attacher Jun 19 06:24:29.610: INFO: creating *v1.ClusterRole: external-attacher-runner-snapshotting-3870 Jun 19 06:24:29.610: INFO: Define cluster role external-attacher-runner-snapshotting-3870 Jun 19 06:24:29.649: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-3870 Jun 19 06:24:29.685: INFO: creating *v1.Role: snapshotting-3870-4513/external-attacher-cfg-snapshotting-3870 Jun 19 06:24:29.721: INFO: creating *v1.RoleBinding: snapshotting-3870-4513/csi-attacher-role-cfg Jun 19 06:24:29.758: INFO: creating *v1.ServiceAccount: snapshotting-3870-4513/csi-provisioner Jun 19 06:24:29.794: INFO: creating *v1.ClusterRole: external-provisioner-runner-snapshotting-3870 Jun 19 06:24:29.794: INFO: Define cluster role external-provisioner-runner-snapshotting-3870 Jun 19 06:24:29.832: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-3870 Jun 19 06:24:29.869: INFO: creating *v1.Role: snapshotting-3870-4513/external-provisioner-cfg-snapshotting-3870 Jun 19 06:24:29.906: INFO: creating *v1.RoleBinding: snapshotting-3870-4513/csi-provisioner-role-cfg Jun 19 06:24:29.942: INFO: creating *v1.ServiceAccount: snapshotting-3870-4513/csi-gce-pd-controller-sa Jun 19 06:24:29.979: INFO: creating *v1.ClusterRole: csi-gce-pd-provisioner-role-snapshotting-3870 Jun 19 06:24:29.979: INFO: Define cluster role csi-gce-pd-provisioner-role-snapshotting-3870 Jun 19 06:24:30.017: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-provisioner-binding-snapshotting-3870 Jun 19 06:24:30.053: INFO: creating *v1.ClusterRole: csi-gce-pd-attacher-role-snapshotting-3870 Jun 19 06:24:30.053: INFO: Define cluster role csi-gce-pd-attacher-role-snapshotting-3870 Jun 19 06:24:30.091: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-attacher-binding-snapshotting-3870 Jun 19 06:24:30.130: INFO: creating *v1.ClusterRole: csi-gce-pd-resizer-role-snapshotting-3870 Jun 19 06:24:30.130: INFO: Define cluster role csi-gce-pd-resizer-role-snapshotting-3870 Jun 19 06:24:30.167: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-resizer-binding-snapshotting-3870 Jun 19 06:24:30.204: INFO: creating *v1.ClusterRole: csi-gce-pd-snapshotter-role-snapshotting-3870 Jun 19 06:24:30.204: INFO: Define cluster role csi-gce-pd-snapshotter-role-snapshotting-3870 Jun 19 06:24:30.242: INFO: creating *v1.ClusterRoleBinding: csi-gce-pd-controller-snapshotter-binding-snapshotting-3870 Jun 19 06:24:30.278: INFO: creating *v1.Role: snapshotting-3870-4513/csi-gce-pd-leaderelection-role-snapshotting-3870 Jun 19 06:24:30.314: INFO: creating *v1.RoleBinding: snapshotting-3870-4513/csi-gce-pd-controller-leaderelection-binding Jun 19 06:24:30.350: INFO: creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-snapshotting-3870 Jun 19 06:24:30.388: INFO: creating *v1.DaemonSet: snapshotting-3870-4513/csi-gce-pd-node Jun 19 06:24:30.427: INFO: creating *v1.StatefulSet: snapshotting-3870-4513/csi-gce-pd-controller Jun 19 06:24:30.588: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-qcp1 Jun 19 06:24:35.753: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-v98m Jun 19 06:24:35.788: INFO: waiting for CSIDriver pd.csi.storage.gke.io to register on node bootstrap-e2e-minion-group-vg14 Jun 19 06:24:35.823: INFO: Creating resource for dynamic PV Jun 19 06:24:35.823: INFO: Using claimSize:5Gi, test suite supported size:{ 1Mi}, driver(pd.csi.storage.gke.io) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass snapshotting-3870gc4r6 �[1mSTEP�[0m: creating a claim Jun 19 06:24:35.860: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: [init] starting a pod to use the claim �[1mSTEP�[0m: [init] check pod success Jun 19 06:24:36.014: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-zhl45" in namespace "snapshotting-3870" to be "Succeeded or Failed" Jun 19 06:24:36.050: INFO: Pod "pvc-snapshottable-tester-zhl45": Phase="Pending", Reason="", readiness=false. Elapsed: 35.743904ms Jun 19 06:24:38.087: INFO: Pod "pvc-snapshottable-tester-zhl45": Phase="Pending", Reason="", readiness=false. Elapsed: 2.072933422s Jun 19 06:24:40.087: INFO: Pod "pvc-snapshottable-tester-zhl45": Phase="Pending", Reason="", readiness=false. Elapsed: 4.073215047s Jun 19 06:24:42.087: INFO: Pod "pvc-snapshottable-tester-zhl45": Phase="Pending", Reason="", readiness=false. Elapsed: 6.072733266s Jun 19 06:24:44.087: INFO: Pod "pvc-snapshottable-tester-zhl45": Phase="Pending", Reason="", readiness=false. Elapsed: 8.073238269s Jun 19 06:24:46.087: INFO: Pod "pvc-snapshottable-tester-zhl45": Phase="Pending", Reason="", readiness=false. Elapsed: 10.072830683s Jun 19 06:24:48.097: INFO: Pod "pvc-snapshottable-tester-zhl45": Phase="Pending", Reason="", readiness=false. Elapsed: 12.082959369s Jun 19 06:24:50.087: INFO: Pod "pvc-snapshottable-tester-zhl45": Phase="Pending", Reason="", readiness=false. Elapsed: 14.072641444s Jun 19 06:24:52.087: INFO: Pod "pvc-snapshottable-tester-zhl45": Phase="Pending", Reason="", readiness=false. Elapsed: 16.072763061s Jun 19 06:24:54.086: INFO: Pod "pvc-snapshottable-tester-zhl45": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.072290615s �[1mSTEP�[0m: Saw pod success Jun 19 06:24:54.086: INFO: Pod "pvc-snapshottable-tester-zhl45" satisfied condition "Succeeded or Failed" �[1mSTEP�[0m: [init] checking the claim Jun 19 06:24:54.123: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pd.csi.storage.gke.io92tzh] to have phase Bound Jun 19 06:24:54.158: INFO: PersistentVolumeClaim pd.csi.storage.gke.io92tzh found and phase=Bound (35.24601ms) �[1mSTEP�[0m: [init] checking the PV �[1mSTEP�[0m: [init] deleting the pod Jun 19 06:24:54.281: INFO: Pod pvc-snapshottable-tester-zhl45 has the following logs: Jun 19 06:24:54.281: INFO: Deleting pod "pvc-snapshottable-tester-zhl45" in namespace "snapshotting-3870" Jun 19 06:24:54.336: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-zhl45" to be fully deleted �[1mSTEP�[0m: [init] waiting until the node=bootstrap-e2e-minion-group-vg14 is not using the volume=projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/disks/pvc-0fc555ce-b9fd-492f-b504-79fb50763446 Jun 19 06:24:54.407: INFO: current volumes in use: [kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/disks/pvc-0fc555ce-b9fd-492f-b504-79fb50763446] Jun 19 06:24:56.445: INFO: current volumes in use: [kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/disks/pvc-0fc555ce-b9fd-492f-b504-79fb50763446] Jun 19 06:24:58.482: INFO: current volumes in use: [kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/disks/pvc-0fc555ce-b9fd-492f-b504-79fb50763446] Jun 19 06:25:00.520: INFO: current volumes in use: [] Jun 19 06:25:00.520: INFO: WaitUntil finished successfully after 6.148903886s �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 19 06:25:00.638: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-sh2sx to become ready Jun 19 06:25:00.681: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:02.719: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:04.756: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:06.793: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:08.830: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:10.866: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:12.902: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:14.940: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:16.989: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:19.026: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:21.063: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:23.104: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:25.141: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:27.178: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:29.215: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:31.251: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:33.288: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:35.325: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:37.364: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:39.401: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:41.437: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:43.473: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:45.510: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:47.548: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:49.584: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:51.688: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:53.726: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:55.763: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:57.801: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:25:59.837: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:01.874: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:03.910: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:05.947: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:07.984: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:10.022: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:12.059: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:14.096: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:16.133: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:18.171: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:20.209: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:22.247: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:24.284: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:26.320: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:28.360: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:30.396: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:32.434: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:34.471: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:36.508: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:38.548: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:40.585: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:42.694: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:44.732: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:46.769: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:48.811: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:50.847: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:52.884: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:54.921: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:56.959: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:26:58.996: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:01.034: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:03.072: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:05.108: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:07.147: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:09.184: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:11.222: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:13.261: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:15.298: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:17.336: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:19.373: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:21.411: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:23.450: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:25.488: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:27.526: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:29.563: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:31.600: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:33.638: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:35.675: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:37.713: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:39.751: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:41.788: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:43.825: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:45.861: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:47.900: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:49.938: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:51.974: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:54.011: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:56.047: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:27:58.085: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:00.122: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:02.159: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:04.202: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:06.238: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:08.275: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:10.312: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:12.350: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:14.386: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:16.424: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:18.461: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:20.497: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:22.545: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:24.582: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:26.620: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:28.657: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:30.699: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:32.738: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:34.776: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:36.818: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:38.854: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:40.894: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:42.935: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:44.971: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:47.009: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:49.045: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:51.082: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:53.128: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:55.170: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:57.211: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:28:59.254: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:01.294: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:03.335: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:05.372: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:07.409: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:09.445: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:11.482: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:13.526: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:15.563: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:17.600: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:19.638: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:21.675: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:23.712: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:25.750: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:27.789: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:29.826: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:31.863: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:33.900: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:35.937: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:37.976: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:40.013: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:42.050: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:44.087: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:46.123: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:48.165: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:50.202: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:52.240: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:54.278: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:56.314: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:29:58.353: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:30:00.390: INFO: VolumeSnapshot snapshot-sh2sx found but is not ready. Jun 19 06:30:02.391: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 19 06:30:02.391: INFO: Unexpected error: <*errors.errorString | 0xc00339dbe0>: { s: "VolumeSnapshot snapshot-sh2sx is not ready within 5m0s", } Jun 19 06:30:02.391: FAIL: VolumeSnapshot snapshot-sh2sx is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc002d893a8?}, 0xc003c76258) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f9d6c166220, 0xc0010c1860}, 0xc0043301e0, {{0x71ffffc, 0x28}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.4.2() test/e2e/storage/testsuites/snapshottable.go:359 +0xb7d k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: updating the snapshot content deletion policy to retain [AfterEach] volume snapshot controller test/e2e/storage/testsuites/snapshottable.go:172 �[1mSTEP�[0m: Deleting pvc Jun 19 06:30:02.464: INFO: Deleting PersistentVolumeClaim "pd.csi.storage.gke.io92tzh" Jun 19 06:30:02.505: INFO: Waiting up to 5m0s for PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 to get deleted Jun 19 06:30:02.541: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (35.684551ms) Jun 19 06:30:07.584: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (5.079314215s) Jun 19 06:30:12.621: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (10.115736079s) Jun 19 06:30:17.659: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (15.15421647s) Jun 19 06:30:22.701: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (20.195754541s) Jun 19 06:30:27.744: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (25.239223439s) Jun 19 06:30:32.839: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (30.334233807s) Jun 19 06:30:37.925: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (35.419997012s) Jun 19 06:30:43.021: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (40.515726027s) Jun 19 06:30:48.071: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (45.565731653s) Jun 19 06:30:53.124: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (50.618437563s) Jun 19 06:30:58.170: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (55.665347226s) Jun 19 06:31:03.220: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m0.714825047s) Jun 19 06:31:08.271: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m5.765481292s) Jun 19 06:31:13.320: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m10.815320023s) Jun 19 06:31:18.426: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m15.921400975s) Jun 19 06:31:23.530: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m21.025216469s) Jun 19 06:31:28.636: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m26.130524413s) Jun 19 06:31:33.720: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m31.215364177s) Jun 19 06:31:38.824: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m36.319406475s) Jun 19 06:31:43.920: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m41.414773548s) Jun 19 06:31:48.972: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m46.466958427s) Jun 19 06:31:54.069: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m51.564408778s) Jun 19 06:31:59.120: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (1m56.614873714s) Jun 19 06:32:04.169: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m1.664366316s) Jun 19 06:32:09.220: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m6.714577207s) Jun 19 06:32:14.269: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m11.764248685s) Jun 19 06:32:19.320: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m16.814868855s) Jun 19 06:32:24.370: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m21.864869797s) Jun 19 06:32:29.419: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m26.914333739s) Jun 19 06:32:34.470: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m31.964592399s) Jun 19 06:32:39.520: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m37.0149028s) Jun 19 06:32:44.571: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m42.065495033s) Jun 19 06:32:49.624: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m47.118597634s) Jun 19 06:32:54.720: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m52.214537788s) Jun 19 06:32:59.770: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (2m57.264509039s) Jun 19 06:33:04.820: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m2.315004346s) Jun 19 06:33:09.870: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m7.365017167s) Jun 19 06:33:14.969: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m12.464055698s) Jun 19 06:33:20.021: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m17.516048941s) Jun 19 06:33:25.071: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m22.565727213s) Jun 19 06:33:30.170: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m27.665111046s) Jun 19 06:33:35.220: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m32.714750475s) Jun 19 06:33:40.270: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m37.764588255s) Jun 19 06:33:45.319: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m42.813804097s) Jun 19 06:33:50.369: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m47.864171273s) Jun 19 06:33:55.420: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m52.914746895s) Jun 19 06:34:00.470: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (3m57.965311944s) Jun 19 06:34:05.520: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m3.014884777s) Jun 19 06:34:10.569: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m8.06439517s) Jun 19 06:34:15.632: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m13.126481151s) Jun 19 06:34:20.670: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m18.16517238s) Jun 19 06:34:25.720: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m23.214657953s) Jun 19 06:34:30.775: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m28.270364325s) Jun 19 06:34:35.869: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m33.364424545s) Jun 19 06:34:40.920: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m38.414537827s) Jun 19 06:34:45.982: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m43.477168765s) Jun 19 06:34:51.070: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m48.565330696s) Jun 19 06:34:56.120: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m53.614918921s) Jun 19 06:35:01.170: INFO: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 found and phase=Bound (4m58.66523436s) �[1mSTEP�[0m: Deleting sc Jun 19 06:35:06.223: INFO: Unexpected error: <errors.aggregate | len:1, cap:1>: [ { msg: "persistent Volume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 not deleted by dynamic provisioner: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 still exists within 5m0s", err: { s: "PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 still exists within 5m0s", }, }, ] Jun 19 06:35:06.225: FAIL: persistent Volume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 not deleted by dynamic provisioner: PersistentVolume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 still exists within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.1.1() test/e2e/storage/testsuites/snapshottable.go:142 +0x3c k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0xc00058deb0?) test/e2e/storage/utils/utils.go:714 +0x6d k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.2() test/e2e/storage/testsuites/snapshottable.go:167 +0x38 k8s.io/kubernetes/test/e2e/storage/testsuites.(*snapshottableTestSuite).DefineTests.func1.3() test/e2e/storage/testsuites/snapshottable.go:173 +0x1b k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: deleting the test namespace: snapshotting-3870 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-3870". �[1mSTEP�[0m: Found 10 events. Jun 19 06:35:06.321: INFO: At 2022-06-19 06:24:35 +0000 UTC - event for pd.csi.storage.gke.io92tzh: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jun 19 06:35:06.321: INFO: At 2022-06-19 06:24:35 +0000 UTC - event for pd.csi.storage.gke.io92tzh: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "pd.csi.storage.gke.io" or manually created by system administrator Jun 19 06:35:06.321: INFO: At 2022-06-19 06:24:35 +0000 UTC - event for pd.csi.storage.gke.io92tzh: {pd.csi.storage.gke.io_bootstrap-e2e-minion-group-v98m_32ca95ac-44b7-46f4-8725-67210a976843 } Provisioning: External provisioner is provisioning volume for claim "snapshotting-3870/pd.csi.storage.gke.io92tzh" Jun 19 06:35:06.321: INFO: At 2022-06-19 06:24:39 +0000 UTC - event for pd.csi.storage.gke.io92tzh: {pd.csi.storage.gke.io_bootstrap-e2e-minion-group-v98m_32ca95ac-44b7-46f4-8725-67210a976843 } ProvisioningSucceeded: Successfully provisioned volume pvc-0fc555ce-b9fd-492f-b504-79fb50763446 Jun 19 06:35:06.321: INFO: At 2022-06-19 06:24:39 +0000 UTC - event for pvc-snapshottable-tester-zhl45: {default-scheduler } Scheduled: Successfully assigned snapshotting-3870/pvc-snapshottable-tester-zhl45 to bootstrap-e2e-minion-group-vg14 Jun 19 06:35:06.321: INFO: At 2022-06-19 06:24:49 +0000 UTC - event for pvc-snapshottable-tester-zhl45: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-0fc555ce-b9fd-492f-b504-79fb50763446" Jun 19 06:35:06.321: INFO: At 2022-06-19 06:24:50 +0000 UTC - event for pvc-snapshottable-tester-zhl45: {kubelet bootstrap-e2e-minion-group-vg14} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 19 06:35:06.321: INFO: At 2022-06-19 06:24:50 +0000 UTC - event for pvc-snapshottable-tester-zhl45: {kubelet bootstrap-e2e-minion-group-vg14} Created: Created container volume-tester Jun 19 06:35:06.321: INFO: At 2022-06-19 06:24:51 +0000 UTC - event for pvc-snapshottable-tester-zhl45: {kubelet bootstrap-e2e-minion-group-vg14} Started: Started container volume-tester Jun 19 06:35:06.321: INFO: At 2022-06-19 06:25:00 +0000 UTC - event for snapshot-sh2sx: {snapshot-controller } CreatingSnapshot: Waiting for a snapshot snapshotting-3870/snapshot-sh2sx to be created by the CSI driver. Jun 19 06:35:06.420: INFO: POD NODE PHASE GRACE CONDITIONS Jun 19 06:35:06.420: INFO: Jun 19 06:35:06.521: INFO: Logging node info for node bootstrap-e2e-master Jun 19 06:35:06.621: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master b70a79b4-f34d-45f8-938e-6f3b3224ddac 7374 0 2022-06-19 05:52:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/instances/bootstrap-e2e-master"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:30:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:22 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:22 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:22 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:30:22 +0000 UTC,LastTransitionTime:2022-06-19 05:52:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.127.118.154,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d48293e9fabdc7ca70d161b06af3da10,SystemUUID:d48293e9-fabd-c7ca-70d1-61b06af3da10,BootID:0f6cfa59-e1ee-4de4-bf6f-4e1f12698e99,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:117361473,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:35:06.622: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 19 06:35:06.724: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 19 06:35:06.840: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:06.840: INFO: Container etcd-container ready: true, restart count 0 Jun 19 06:35:06.840: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:06.840: INFO: Container etcd-container ready: true, restart count 0 Jun 19 06:35:06.840: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:06.840: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 19 06:35:06.840: INFO: metadata-proxy-v0.1-dftl5 started at 2022-06-19 05:52:34 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:06.840: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:35:06.840: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:35:06.840: INFO: csi-gce-pd-node-wztdg started at 2022-06-19 06:24:30 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:06.840: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 19 06:35:06.840: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 19 06:35:06.840: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:06.840: INFO: Container kube-apiserver ready: true, restart count 0 Jun 19 06:35:06.840: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:06.840: INFO: Container kube-scheduler ready: true, restart count 0 Jun 19 06:35:06.840: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-19 05:51:08 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:06.840: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 19 06:35:06.840: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:06.840: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 19 06:35:06.840: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:06.840: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 19 06:35:07.316: INFO: Latency metrics for node bootstrap-e2e-master Jun 19 06:35:07.316: INFO: Logging node info for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:35:07.371: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qcp1 f578c18d-9d7d-4046-a3c5-035049291f46 7754 0 2022-06-19 05:52:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qcp1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/instances/bootstrap-e2e-minion-group-qcp1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:30:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 06:32:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-qcp1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821426688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559282688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:17 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:17 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:17 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:30:17 +0000 UTC,LastTransitionTime:2022-06-19 05:52:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.199.146.124,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23ad93bfd15643880ef5ec43ad77f973,SystemUUID:23ad93bf-d156-4388-0ef5-ec43ad77f973,BootID:7ac23b1d-549e-44ef-9eaa-3dbb749ded08,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:35:07.371: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:35:07.473: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qcp1 Jun 19 06:35:07.663: INFO: konnectivity-agent-z92tr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:07.663: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:35:07.663: INFO: kube-proxy-bootstrap-e2e-minion-group-qcp1 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:07.663: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:35:07.663: INFO: metadata-proxy-v0.1-8p6rv started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:07.663: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:35:07.663: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:35:07.663: INFO: csi-gce-pd-node-8zc6n started at 2022-06-19 06:24:30 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:07.663: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 19 06:35:07.663: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 19 06:35:07.663: INFO: coredns-85bc9d67b-hzkc7 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:07.663: INFO: Container coredns ready: true, restart count 0 Jun 19 06:35:07.663: INFO: volume-snapshot-controller-0 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:07.663: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 19 06:35:07.663: INFO: kube-dns-autoscaler-5477bd659c-plscr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:07.663: INFO: Container autoscaler ready: true, restart count 0 Jun 19 06:35:07.663: INFO: l7-default-backend-5f6f9745f9-7t4pf started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:07.663: INFO: Container default-http-backend ready: true, restart count 0 Jun 19 06:35:07.989: INFO: Latency metrics for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:35:07.989: INFO: Logging node info for node bootstrap-e2e-minion-group-v98m Jun 19 06:35:08.072: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-v98m 75fa2a8c-51fd-4106-aa37-3a44a456bdf3 7759 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-v98m kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/instances/bootstrap-e2e-minion-group-v98m"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 06:32:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-v98m,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:30:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.168.72.251,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:471d705f22032fce16758d01e419fd6f,SystemUUID:471d705f-2203-2fce-1675-8d01e419fd6f,BootID:1ec48621-6cc9-4851-bac7-4039e6e09109,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:dc0301d9a43e23e389abb7690cd631f98af76ea3429259c7f5f643fd31fc0a3e registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0],SizeBytes:27914152,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:35:08.072: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-v98m Jun 19 06:35:08.172: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-v98m Jun 19 06:35:08.313: INFO: metrics-server-v0.5.2-755d66fb57-jtgcf started at 2022-06-19 05:53:00 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:08.313: INFO: Container metrics-server ready: true, restart count 0 Jun 19 06:35:08.313: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 19 06:35:08.313: INFO: csi-gce-pd-node-5qbnr started at 2022-06-19 06:24:30 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:08.313: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 19 06:35:08.313: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 19 06:35:08.313: INFO: csi-gce-pd-controller-0 started at 2022-06-19 06:24:30 +0000 UTC (0+5 container statuses recorded) Jun 19 06:35:08.313: INFO: Container csi-attacher ready: true, restart count 0 Jun 19 06:35:08.313: INFO: Container csi-provisioner ready: true, restart count 0 Jun 19 06:35:08.313: INFO: Container csi-resizer ready: true, restart count 0 Jun 19 06:35:08.313: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 19 06:35:08.313: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 19 06:35:08.313: INFO: kube-proxy-bootstrap-e2e-minion-group-v98m started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:08.313: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:35:08.313: INFO: metadata-proxy-v0.1-spzmg started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:08.313: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:35:08.313: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:35:08.313: INFO: konnectivity-agent-87hwr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:08.313: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:35:08.639: INFO: Latency metrics for node bootstrap-e2e-minion-group-v98m Jun 19 06:35:08.640: INFO: Logging node info for node bootstrap-e2e-minion-group-vg14 Jun 19 06:35:08.721: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-vg14 1d72ee75-4603-4a55-b2e8-270e62899bc0 7752 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-vg14 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-vg14 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-e2e-gce-gci-serial/zones/us-west1-b/instances/bootstrap-e2e-minion-group-vg14"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 06:24:49 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:30:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 06:32:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-vg14,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:05 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:05 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:05 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:30:05 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.23.69,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39085846033450b547007ba5da404b34,SystemUUID:39085846-0334-50b5-4700-7ba5da404b34,BootID:9d0a40ab-cad4-4158-bdf2-064a38204d74,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:35:08.721: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-vg14 Jun 19 06:35:08.823: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-vg14 Jun 19 06:35:08.944: INFO: konnectivity-agent-8srbc started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:08.944: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:35:08.944: INFO: coredns-85bc9d67b-rdq7m started at 2022-06-19 05:52:52 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:08.944: INFO: Container coredns ready: true, restart count 0 Jun 19 06:35:08.944: INFO: csi-gce-pd-node-t6t4x started at 2022-06-19 06:24:30 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:08.944: INFO: Container csi-driver-registrar ready: true, restart count 0 Jun 19 06:35:08.944: INFO: Container gce-pd-driver ready: true, restart count 0 Jun 19 06:35:08.944: INFO: kube-proxy-bootstrap-e2e-minion-group-vg14 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:08.944: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:35:08.944: INFO: metadata-proxy-v0.1-p2ll4 started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:08.944: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:35:08.944: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:35:09.324: INFO: Latency metrics for node bootstrap-e2e-minion-group-vg14 �[1mSTEP�[0m: Waiting for namespaces [snapshotting-3870] to vanish �[1mSTEP�[0m: uninstalling csi gce-pd driver Jun 19 06:35:21.520: INFO: deleting *v1.ServiceAccount: snapshotting-3870-4513/csi-attacher Jun 19 06:35:21.627: INFO: deleting *v1.ClusterRole: external-attacher-runner-snapshotting-3870 Jun 19 06:35:21.721: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-snapshotting-3870 Jun 19 06:35:21.822: INFO: deleting *v1.Role: snapshotting-3870-4513/external-attacher-cfg-snapshotting-3870 Jun 19 06:35:21.947: INFO: deleting *v1.RoleBinding: snapshotting-3870-4513/csi-attacher-role-cfg Jun 19 06:35:22.026: INFO: deleting *v1.ServiceAccount: snapshotting-3870-4513/csi-provisioner Jun 19 06:35:22.122: INFO: deleting *v1.ClusterRole: external-provisioner-runner-snapshotting-3870 Jun 19 06:35:22.222: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-snapshotting-3870 Jun 19 06:35:22.322: INFO: deleting *v1.Role: snapshotting-3870-4513/external-provisioner-cfg-snapshotting-3870 Jun 19 06:35:22.423: INFO: deleting *v1.RoleBinding: snapshotting-3870-4513/csi-provisioner-role-cfg Jun 19 06:35:22.523: INFO: deleting *v1.ServiceAccount: snapshotting-3870-4513/csi-gce-pd-controller-sa Jun 19 06:35:22.637: INFO: deleting *v1.ClusterRole: csi-gce-pd-provisioner-role-snapshotting-3870 Jun 19 06:35:22.726: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-provisioner-binding-snapshotting-3870 Jun 19 06:35:22.824: INFO: deleting *v1.ClusterRole: csi-gce-pd-attacher-role-snapshotting-3870 Jun 19 06:35:22.923: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-attacher-binding-snapshotting-3870 Jun 19 06:35:23.021: INFO: deleting *v1.ClusterRole: csi-gce-pd-resizer-role-snapshotting-3870 Jun 19 06:35:23.122: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-resizer-binding-snapshotting-3870 Jun 19 06:35:23.221: INFO: deleting *v1.ClusterRole: csi-gce-pd-snapshotter-role-snapshotting-3870 Jun 19 06:35:23.322: INFO: deleting *v1.ClusterRoleBinding: csi-gce-pd-controller-snapshotter-binding-snapshotting-3870 Jun 19 06:35:23.422: INFO: deleting *v1.Role: snapshotting-3870-4513/csi-gce-pd-leaderelection-role-snapshotting-3870 Jun 19 06:35:23.521: INFO: deleting *v1.RoleBinding: snapshotting-3870-4513/csi-gce-pd-controller-leaderelection-binding Jun 19 06:35:23.625: INFO: deleting *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-snapshotting-3870 Jun 19 06:35:23.721: INFO: deleting *v1.DaemonSet: snapshotting-3870-4513/csi-gce-pd-node Jun 19 06:35:23.822: INFO: deleting *v1.StatefulSet: snapshotting-3870-4513/csi-gce-pd-controller �[1mSTEP�[0m: deleting the driver namespace: snapshotting-3870-4513 �[1mSTEP�[0m: Collecting events from namespace "snapshotting-3870-4513". �[1mSTEP�[0m: Found 69 events. Jun 19 06:35:24.027: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-controller: {statefulset-controller } SuccessfulCreate: create Pod csi-gce-pd-controller-0 in StatefulSet csi-gce-pd-controller successful Jun 19 06:35:24.027: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-controller-0: {default-scheduler } Scheduled: Successfully assigned snapshotting-3870-4513/csi-gce-pd-controller-0 to bootstrap-e2e-minion-group-v98m Jun 19 06:35:24.028: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-8zc6n Jun 19 06:35:24.028: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-t6t4x Jun 19 06:35:24.028: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-wztdg Jun 19 06:35:24.029: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-node: {daemonset-controller } SuccessfulCreate: Created pod: csi-gce-pd-node-5qbnr Jun 19 06:35:24.029: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-node-5qbnr: {default-scheduler } Scheduled: Successfully assigned snapshotting-3870-4513/csi-gce-pd-node-5qbnr to bootstrap-e2e-minion-group-v98m Jun 19 06:35:24.030: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-node-8zc6n: {default-scheduler } Scheduled: Successfully assigned snapshotting-3870-4513/csi-gce-pd-node-8zc6n to bootstrap-e2e-minion-group-qcp1 Jun 19 06:35:24.031: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-node-t6t4x: {kubelet bootstrap-e2e-minion-group-vg14} Pulled: Container image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" already present on machine Jun 19 06:35:24.031: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-node-t6t4x: {default-scheduler } Scheduled: Successfully assigned snapshotting-3870-4513/csi-gce-pd-node-t6t4x to bootstrap-e2e-minion-group-vg14 Jun 19 06:35:24.032: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-node-wztdg: {default-scheduler } Scheduled: Successfully assigned snapshotting-3870-4513/csi-gce-pd-node-wztdg to bootstrap-e2e-master Jun 19 06:35:24.032: INFO: At 2022-06-19 06:24:30 +0000 UTC - event for csi-gce-pd-node-wztdg: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" already present on machine Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1" in 208.844774ms Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-provisioner Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-provisioner Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-provisioner:v3.1.0" already present on machine Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-snapshotter Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-attacher:v3.4.0" already present on machine Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-snapshotter Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulling: Pulling image "registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1" Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-attacher Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-5qbnr: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-5qbnr: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" already present on machine Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-5qbnr: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-driver-registrar Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-5qbnr: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-driver-registrar Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-5qbnr: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" already present on machine Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-5qbnr: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-8zc6n: {kubelet bootstrap-e2e-minion-group-qcp1} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-8fzcp" : failed to sync configmap cache: timed out waiting for the condition Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-t6t4x: {kubelet bootstrap-e2e-minion-group-vg14} Started: Started container csi-driver-registrar Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-t6t4x: {kubelet bootstrap-e2e-minion-group-vg14} Pulled: Container image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" already present on machine Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-t6t4x: {kubelet bootstrap-e2e-minion-group-vg14} Created: Created container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-t6t4x: {kubelet bootstrap-e2e-minion-group-vg14} Created: Created container csi-driver-registrar Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-t6t4x: {kubelet bootstrap-e2e-minion-group-vg14} Started: Started container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-wztdg: {kubelet bootstrap-e2e-master} Created: Created container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-wztdg: {kubelet bootstrap-e2e-master} Started: Started container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-wztdg: {kubelet bootstrap-e2e-master} Started: Started container csi-driver-registrar Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-wztdg: {kubelet bootstrap-e2e-master} Created: Created container csi-driver-registrar Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:31 +0000 UTC - event for csi-gce-pd-node-wztdg: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" already present on machine Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0" already present on machine Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Created: Created container csi-resizer Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-resizer Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Started: Started container csi-attacher Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Pulled: Container image "registry.k8s.io/sig-storage/csi-resizer:v1.4.0" already present on machine Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-node-8zc6n: {kubelet bootstrap-e2e-minion-group-qcp1} Pulled: Container image "registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2" already present on machine Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-node-8zc6n: {kubelet bootstrap-e2e-minion-group-qcp1} Pulled: Container image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0" already present on machine Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-node-8zc6n: {kubelet bootstrap-e2e-minion-group-qcp1} Created: Created container csi-driver-registrar Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-node-8zc6n: {kubelet bootstrap-e2e-minion-group-qcp1} Started: Started container csi-driver-registrar Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for csi-gce-pd-node-8zc6n: {kubelet bootstrap-e2e-minion-group-qcp1} Created: Created container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for external-snapshotter-leader-pd-csi-storage-gke-io: {external-snapshotter-leader-pd.csi.storage.gke.io/bootstrap-e2e-minion-group-v98m } LeaderElection: bootstrap-e2e-minion-group-v98m became leader Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:32 +0000 UTC - event for pd-csi-storage-gke-io: {pd.csi.storage.gke.io/bootstrap-e2e-minion-group-v98m } LeaderElection: bootstrap-e2e-minion-group-v98m became leader Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:33 +0000 UTC - event for csi-gce-pd-node-8zc6n: {kubelet bootstrap-e2e-minion-group-qcp1} Started: Started container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:33 +0000 UTC - event for external-attacher-leader-pd-csi-storage-gke-io: {external-attacher-leader-pd.csi.storage.gke.io/bootstrap-e2e-minion-group-v98m } LeaderElection: bootstrap-e2e-minion-group-v98m became leader Jun 19 06:35:24.033: INFO: At 2022-06-19 06:24:33 +0000 UTC - event for external-resizer-pd-csi-storage-gke-io: {external-resizer-pd-csi-storage-gke-io/bootstrap-e2e-minion-group-v98m } LeaderElection: bootstrap-e2e-minion-group-v98m became leader Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Killing: Stopping container csi-resizer Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Killing: Stopping container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-controller-0: {kubelet bootstrap-e2e-minion-group-v98m} Killing: Stopping container csi-snapshotter Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-node-5qbnr: {kubelet bootstrap-e2e-minion-group-v98m} Killing: Stopping container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-node-5qbnr: {kubelet bootstrap-e2e-minion-group-v98m} Killing: Stopping container csi-driver-registrar Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-node-5qbnr: {kubelet bootstrap-e2e-minion-group-v98m} FailedPreStopHook: Exec lifecycle hook ([/bin/sh -c rm -rf /registration/pd.csi.storage.gke.io /registration/pd.csi.storage.gke.io-reg.sock]) for Container "csi-driver-registrar" in Pod "csi-gce-pd-node-5qbnr_snapshotting-3870-4513(c3d33fb0-31b2-44ce-8fe5-bfe3bb85207f)" failed - error: rpc error: code = Unknown desc = failed to exec in container: failed to start exec "6b1003b515a80266c5a62e0ac9bc3c27cd800a8751f80ff87724570f03d972f8": OCI runtime exec failed: exec failed: container_linux.go:380: starting container process caused: exec: "/bin/sh": stat /bin/sh: no such file or directory: unknown, message: "" Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-node-8zc6n: {kubelet bootstrap-e2e-minion-group-qcp1} FailedPreStopHook: Exec lifecycle hook ([/bin/sh -c rm -rf /registration/pd.csi.storage.gke.io /registration/pd.csi.storage.gke.io-reg.sock]) for Container "csi-driver-registrar" in Pod "csi-gce-pd-node-8zc6n_snapshotting-3870-4513(0be35287-f67d-4da8-9cc7-2a263f8f4db0)" failed - error: rpc error: code = Unknown desc = failed to exec in container: failed to start exec "7d872e47b9e66035b7ed1e19d75d22fa20043e668099138ec683d638e667827d": OCI runtime exec failed: exec failed: container_linux.go:380: starting container process caused: exec: "/bin/sh": stat /bin/sh: no such file or directory: unknown, message: "" Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-node-8zc6n: {kubelet bootstrap-e2e-minion-group-qcp1} Killing: Stopping container csi-driver-registrar Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-node-8zc6n: {kubelet bootstrap-e2e-minion-group-qcp1} Killing: Stopping container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-node-t6t4x: {kubelet bootstrap-e2e-minion-group-vg14} Killing: Stopping container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-node-t6t4x: {kubelet bootstrap-e2e-minion-group-vg14} Killing: Stopping container csi-driver-registrar Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-node-t6t4x: {kubelet bootstrap-e2e-minion-group-vg14} FailedPreStopHook: Exec lifecycle hook ([/bin/sh -c rm -rf /registration/pd.csi.storage.gke.io /registration/pd.csi.storage.gke.io-reg.sock]) for Container "csi-driver-registrar" in Pod "csi-gce-pd-node-t6t4x_snapshotting-3870-4513(f2f21d2e-9362-464b-a477-e1524cf002af)" failed - error: rpc error: code = Unknown desc = failed to exec in container: failed to start exec "3fb8d205bf4c22bd609da00e05a5e880f993342c834449fbb6b34abac23cd45b": OCI runtime exec failed: exec failed: container_linux.go:380: starting container process caused: exec: "/bin/sh": stat /bin/sh: no such file or directory: unknown, message: "" Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-node-wztdg: {kubelet bootstrap-e2e-master} Killing: Stopping container gce-pd-driver Jun 19 06:35:24.033: INFO: At 2022-06-19 06:35:23 +0000 UTC - event for csi-gce-pd-node-wztdg: {kubelet bootstrap-e2e-master} Killing: Stopping container csi-driver-registrar Jun 19 06:35:24.125: INFO: POD NODE PHASE GRACE CONDITIONS Jun 19 06:35:24.125: INFO: csi-gce-pd-controller-0 bootstrap-e2e-minion-group-v98m Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:30 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:33 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:33 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:30 +0000 UTC }] Jun 19 06:35:24.125: INFO: csi-gce-pd-node-5qbnr bootstrap-e2e-minion-group-v98m Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:30 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:32 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:30 +0000 UTC }] Jun 19 06:35:24.125: INFO: csi-gce-pd-node-8zc6n bootstrap-e2e-minion-group-qcp1 Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:30 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:33 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:33 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:30 +0000 UTC }] Jun 19 06:35:24.125: INFO: csi-gce-pd-node-t6t4x bootstrap-e2e-minion-group-vg14 Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:30 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:31 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:31 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:30 +0000 UTC }] Jun 19 06:35:24.125: INFO: csi-gce-pd-node-wztdg bootstrap-e2e-master Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:30 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:32 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-19 06:24:30 +0000 UTC }] Jun 19 06:35:24.125: INFO: Jun 19 06:35:24.883: INFO: Unable to fetch snapshotting-3870-4513/csi-gce-pd-node-wztdg/gce-pd-driver logs: the server could not find the requested resource (get pods csi-gce-pd-node-wztdg) Jun 19 06:35:24.923: INFO: Logging node info for node bootstrap-e2e-master Jun 19 06:35:24.971: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master b70a79b4-f34d-45f8-938e-6f3b3224ddac 8266 0 2022-06-19 05:52:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:30:22 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3864313856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3602169856 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:22 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:22 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:22 +0000 UTC,LastTransitionTime:2022-06-19 05:52:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:30:22 +0000 UTC,LastTransitionTime:2022-06-19 05:52:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.127.118.154,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d48293e9fabdc7ca70d161b06af3da10,SystemUUID:d48293e9-fabd-c7ca-70d1-61b06af3da10,BootID:0f6cfa59-e1ee-4de4-bf6f-4e1f12698e99,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:127453651,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:117361473,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:51080002,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:35:24.971: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 19 06:35:25.024: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 19 06:35:25.084: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.084: INFO: Container l7-lb-controller ready: true, restart count 3 Jun 19 06:35:25.084: INFO: metadata-proxy-v0.1-dftl5 started at 2022-06-19 05:52:34 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:25.084: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:35:25.084: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:35:25.084: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.084: INFO: Container kube-apiserver ready: true, restart count 0 Jun 19 06:35:25.084: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.084: INFO: Container etcd-container ready: true, restart count 0 Jun 19 06:35:25.084: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.084: INFO: Container etcd-container ready: true, restart count 0 Jun 19 06:35:25.084: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-19 05:51:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.084: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 19 06:35:25.084: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.084: INFO: Container kube-controller-manager ready: true, restart count 2 Jun 19 06:35:25.084: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-19 05:51:07 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.084: INFO: Container kube-scheduler ready: true, restart count 0 Jun 19 06:35:25.084: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-19 05:51:08 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.084: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 19 06:35:25.340: INFO: Latency metrics for node bootstrap-e2e-master Jun 19 06:35:25.340: INFO: Logging node info for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:35:25.377: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qcp1 f578c18d-9d7d-4046-a3c5-035049291f46 8264 0 2022-06-19 05:52:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qcp1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-19 06:32:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-19 06:35:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-qcp1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821426688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559282688 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:38 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:35:23 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:35:23 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:35:23 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:35:23 +0000 UTC,LastTransitionTime:2022-06-19 05:52:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.199.146.124,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qcp1.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23ad93bfd15643880ef5ec43ad77f973,SystemUUID:23ad93bf-d156-4388-0ef5-ec43ad77f973,BootID:7ac23b1d-549e-44ef-9eaa-3dbb749ded08,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:35:25.378: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:35:25.416: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qcp1 Jun 19 06:35:25.460: INFO: volume-snapshot-controller-0 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.460: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 19 06:35:25.460: INFO: kube-dns-autoscaler-5477bd659c-plscr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.460: INFO: Container autoscaler ready: true, restart count 0 Jun 19 06:35:25.460: INFO: l7-default-backend-5f6f9745f9-7t4pf started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.460: INFO: Container default-http-backend ready: true, restart count 0 Jun 19 06:35:25.460: INFO: konnectivity-agent-z92tr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.460: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:35:25.460: INFO: kube-proxy-bootstrap-e2e-minion-group-qcp1 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.460: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:35:25.460: INFO: metadata-proxy-v0.1-8p6rv started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:25.460: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:35:25.460: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:35:25.460: INFO: coredns-85bc9d67b-hzkc7 started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.460: INFO: Container coredns ready: true, restart count 0 Jun 19 06:35:25.622: INFO: Latency metrics for node bootstrap-e2e-minion-group-qcp1 Jun 19 06:35:25.622: INFO: Logging node info for node bootstrap-e2e-minion-group-v98m Jun 19 06:35:25.659: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-v98m 75fa2a8c-51fd-4106-aa37-3a44a456bdf3 8272 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-v98m kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 05:52:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-19 06:30:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-19 06:32:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-v98m,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:32:39 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:30:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:30:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.168.72.251,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-v98m.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:471d705f22032fce16758d01e419fd6f,SystemUUID:471d705f-2203-2fce-1675-8d01e419fd6f,BootID:1ec48621-6cc9-4851-bac7-4039e6e09109,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:dc0301d9a43e23e389abb7690cd631f98af76ea3429259c7f5f643fd31fc0a3e registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.4.0],SizeBytes:27914152,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:35:25.660: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-v98m Jun 19 06:35:25.698: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-v98m Jun 19 06:35:25.740: INFO: kube-proxy-bootstrap-e2e-minion-group-v98m started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.740: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:35:25.740: INFO: metadata-proxy-v0.1-spzmg started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:25.740: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:35:25.740: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:35:25.740: INFO: konnectivity-agent-87hwr started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:25.740: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:35:25.740: INFO: metrics-server-v0.5.2-755d66fb57-jtgcf started at 2022-06-19 05:53:00 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:25.740: INFO: Container metrics-server ready: true, restart count 0 Jun 19 06:35:25.740: INFO: Container metrics-server-nanny ready: true, restart count 0 Jun 19 06:35:25.894: INFO: Latency metrics for node bootstrap-e2e-minion-group-v98m Jun 19 06:35:25.894: INFO: Logging node info for node bootstrap-e2e-minion-group-vg14 Jun 19 06:35:25.931: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-vg14 1d72ee75-4603-4a55-b2e8-270e62899bc0 8274 0 2022-06-19 05:52:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-vg14 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.gke.io/zone:us-west1-b topology.hostpath.csi/node:bootstrap-e2e-minion-group-vg14 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-19 05:52:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-19 05:52:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-19 06:24:49 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-19 06:32:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-19 06:35:10 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-e2e-gce-gci-serial/us-west1-b/bootstrap-e2e-minion-group-vg14,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7821434880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7559290880 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-06-19 06:32:37 +0000 UTC,LastTransitionTime:2022-06-19 05:52:32 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-19 05:52:43 +0000 UTC,LastTransitionTime:2022-06-19 05:52:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-19 06:35:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-19 06:35:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-19 06:35:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-19 06:35:10 +0000 UTC,LastTransitionTime:2022-06-19 05:52:38 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.23.69,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-vg14.c.k8s-jkns-e2e-gce-gci-serial.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39085846033450b547007ba5da404b34,SystemUUID:39085846-0334-50b5-4700-7ba5da404b34,BootID:9d0a40ab-cad4-4158-bdf2-064a38204d74,KernelVersion:5.4.129+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.6,KubeletVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,KubeProxyVersion:v1.25.0-alpha.1.40+d2f97bf90c1016,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.40_d2f97bf90c1016],SizeBytes:110647351,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:e9c355dd1ce57de91a0f9164bd2fe688938723e7f9bd40bb13652d603f41d25a registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.2.2],SizeBytes:73354282,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 19 06:35:25.931: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-vg14 Jun 19 06:35:25.972: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-vg14 Jun 19 06:35:26.014: INFO: kube-proxy-bootstrap-e2e-minion-group-vg14 started at 2022-06-19 05:52:28 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:26.014: INFO: Container kube-proxy ready: true, restart count 0 Jun 19 06:35:26.014: INFO: metadata-proxy-v0.1-p2ll4 started at 2022-06-19 05:52:29 +0000 UTC (0+2 container statuses recorded) Jun 19 06:35:26.014: INFO: Container metadata-proxy ready: true, restart count 0 Jun 19 06:35:26.014: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 19 06:35:26.014: INFO: konnectivity-agent-8srbc started at 2022-06-19 05:52:43 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:26.014: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 19 06:35:26.014: INFO: coredns-85bc9d67b-rdq7m started at 2022-06-19 05:52:52 +0000 UTC (0+1 container statuses recorded) Jun 19 06:35:26.014: INFO: Container coredns ready: true, restart count 0 Jun 19 06:35:26.176: INFO: Latency metrics for node bootstrap-e2e-minion-group-vg14 �[1mSTEP�[0m: Waiting for namespaces [snapshotting-3870-4513] to vanish [AfterEach] [Testpattern: Pre-provisioned Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] test/e2e/framework/framework.go:187 Jun 19 06:35:32.250: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\smock\svolume\sCSI\sSnapshot\sController\smetrics\s\[Feature\:VolumeSnapshotDataSource\]\ssnapshot\scontroller\sshould\semit\spre\-provisioned\sCreateSnapshot\,\sCreateSnapshotAndReady\,\sand\sDeleteSnapshot\smetrics$'
test/e2e/storage/csi_mock_volume.go:1891 Jun 19 06:13:24.409: VolumeSnapshot snapshot-4mjlh is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [sig-storage] CSI mock volume test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 19 06:08:08.686: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename csi-mock-volumes �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] snapshot controller should emit pre-provisioned CreateSnapshot, CreateSnapshotAndReady, and DeleteSnapshot metrics test/e2e/storage/csi_mock_volume.go:1891 �[1mSTEP�[0m: Building a driver namespace object, basename csi-mock-volumes-2345 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi mock driver Jun 19 06:08:09.261: INFO: creating *v1.ServiceAccount: csi-mock-volumes-2345-874/csi-attacher Jun 19 06:08:09.298: INFO: creating *v1.ClusterRole: external-attacher-runner-csi-mock-volumes-2345 Jun 19 06:08:09.298: INFO: Define cluster role external-attacher-runner-csi-mock-volumes-2345 Jun 19 06:08:09.336: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-csi-mock-volumes-2345 Jun 19 06:08:09.372: INFO: creating *v1.Role: csi-mock-volumes-2345-874/external-attacher-cfg-csi-mock-volumes-2345 Jun 19 06:08:09.409: INFO: creating *v1.RoleBinding: csi-mock-volumes-2345-874/csi-attacher-role-cfg Jun 19 06:08:09.445: INFO: creating *v1.ServiceAccount: csi-mock-volumes-2345-874/csi-provisioner Jun 19 06:08:09.482: INFO: creating *v1.ClusterRole: external-provisioner-runner-csi-mock-volumes-2345 Jun 19 06:08:09.482: INFO: Define cluster role external-provisioner-runner-csi-mock-volumes-2345 Jun 19 06:08:09.527: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-csi-mock-volumes-2345 Jun 19 06:08:09.563: INFO: creating *v1.Role: csi-mock-volumes-2345-874/external-provisioner-cfg-csi-mock-volumes-2345 Jun 19 06:08:09.600: INFO: creating *v1.RoleBinding: csi-mock-volumes-2345-874/csi-provisioner-role-cfg Jun 19 06:08:09.637: INFO: creating *v1.ServiceAccount: csi-mock-volumes-2345-874/csi-resizer Jun 19 06:08:09.674: INFO: creating *v1.ClusterRole: external-resizer-runner-csi-mock-volumes-2345 Jun 19 06:08:09.674: INFO: Define cluster role external-resizer-runner-csi-mock-volumes-2345 Jun 19 06:08:09.713: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-csi-mock-volumes-2345 Jun 19 06:08:09.750: INFO: creating *v1.Role: csi-mock-volumes-2345-874/external-resizer-cfg-csi-mock-volumes-2345 Jun 19 06:08:09.788: INFO: creating *v1.RoleBinding: csi-mock-volumes-2345-874/csi-resizer-role-cfg Jun 19 06:08:09.825: INFO: creating *v1.ServiceAccount: csi-mock-volumes-2345-874/csi-snapshotter Jun 19 06:08:09.862: INFO: creating *v1.ClusterRole: external-snapshotter-runner-csi-mock-volumes-2345 Jun 19 06:08:09.862: INFO: Define cluster role external-snapshotter-runner-csi-mock-volumes-2345 Jun 19 06:08:09.900: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-csi-mock-volumes-2345 Jun 19 06:08:09.937: INFO: creating *v1.Role: csi-mock-volumes-2345-874/external-snapshotter-leaderelection-csi-mock-volumes-2345 Jun 19 06:08:09.974: INFO: creating *v1.RoleBinding: csi-mock-volumes-2345-874/external-snapshotter-leaderelection Jun 19 06:08:10.010: INFO: creating *v1.ServiceAccount: csi-mock-volumes-2345-874/csi-mock Jun 19 06:08:10.047: INFO: creating *v1.ClusterRoleBinding: csi-controller-attacher-role-csi-mock-volumes-2345 Jun 19 06:08:10.084: INFO: creating *v1.ClusterRoleBinding: csi-controller-provisioner-role-csi-mock-volumes-2345 Jun 19 06:08:10.121: INFO: creating *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-csi-mock-volumes-2345 Jun 19 06:08:10.159: INFO: creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-csi-mock-volumes-2345 Jun 19 06:08:10.195: INFO: creating *v1.ClusterRoleBinding: csi-controller-resizer-role-csi-mock-volumes-2345 Jun 19 06:08:10.232: INFO: creating *v1.ClusterRoleBinding: csi-controller-snapshotter-role-csi-mock-volumes-2345 Jun 19 06:08:10.269: INFO: creating *v1.StorageClass: csi-mock-sc-csi-mock-volumes-2345 Jun 19 06:08:10.306: INFO: creating *v1.StatefulSet: csi-mock-volumes-2345-874/csi-mockplugin Jun 19 06:08:10.346: INFO: creating *v1.CSIDriver: csi-mock-csi-mock-volumes-2345 Jun 19 06:08:10.405: INFO: creating *v1.StatefulSet: csi-mock-volumes-2345-874/csi-mockplugin-snapshotter Jun 19 06:08:10.443: INFO: waiting up to 4m0s for CSIDriver "csi-mock-csi-mock-volumes-2345" Jun 19 06:08:10.480: INFO: waiting for CSIDriver csi-mock-csi-mock-volumes-2345 to register on node bootstrap-e2e-minion-group-vg14 Jun 19 06:08:20.256: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready" Jun 19 06:08:20.292: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=true. Elapsed: 35.85699ms Jun 19 06:08:20.292: INFO: The phase of Pod volume-snapshot-controller-0 is Running (Ready = true) Jun 19 06:08:20.292: INFO: Pod "volume-snapshot-controller-0" satisfied condition "running and ready" �[1mSTEP�[0m: getting all initial metric values �[1mSTEP�[0m: Creating storage class �[1mSTEP�[0m: Creating PVC csi-mock-volumes-2345/snapshot-test-pvc �[1mSTEP�[0m: Wait for PVC to be Bound Jun 19 06:08:20.535: INFO: Waiting up to timeout=1m0s for PersistentVolumeClaims [snapshot-test-pvc] to have phase Bound Jun 19 06:08:20.577: INFO: PersistentVolumeClaim snapshot-test-pvc found but phase is Pending instead of Bound. Jun 19 06:08:22.614: INFO: PersistentVolumeClaim snapshot-test-pvc found and phase=Bound (2.079019924s) �[1mSTEP�[0m: Creating snapshot �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot Jun 19 06:08:22.806: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-4mjlh to become ready Jun 19 06:08:22.851: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:24.888: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:26.925: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:28.962: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:30.999: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:33.037: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:35.074: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:37.112: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:39.149: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:41.186: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:43.223: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:45.260: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:47.297: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:49.335: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:51.372: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:53.409: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:55.446: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:57.487: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:08:59.524: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:01.560: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:03.597: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:05.634: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:07.671: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:09.708: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:11.744: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:13.781: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:15.818: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:17.855: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:19.893: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:21.931: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:23.968: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:26.005: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:28.047: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:30.084: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:32.122: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:34.158: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:36.195: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:38.234: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:40.271: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:42.308: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:44.346: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:46.382: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:48.419: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:50.455: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:52.493: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:54.531: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:56.568: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:09:58.604: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:00.641: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:02.678: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:04.716: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:06.757: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:08.794: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:10.831: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:12.869: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:14.907: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:16.943: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:18.981: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:21.018: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:23.055: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:25.092: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:27.130: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:29.166: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:31.203: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:33.241: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:35.278: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:37.316: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:39.353: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:41.390: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:43.426: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:45.464: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:47.501: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:49.539: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:51.575: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:53.613: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:55.651: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:57.689: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:10:59.726: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:01.762: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:03.801: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:05.837: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:07.874: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:09.911: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:11.947: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:13.985: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:16.032: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:18.071: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:20.108: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:22.145: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:24.182: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:26.219: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:28.257: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:30.294: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:32.333: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:34.371: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:36.409: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:38.446: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:40.483: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:42.520: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:44.556: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:46.593: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:48.630: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:50.668: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:52.705: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:54.743: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:56.780: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:11:58.818: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:00.858: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:02.897: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:04.937: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:06.974: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:09.012: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:11.049: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:13.086: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:15.123: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:17.160: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:19.197: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:21.234: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:23.270: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:25.307: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:27.344: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:29.381: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:31.418: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:33.455: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:35.491: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:37.528: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:39.566: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:41.605: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:43.642: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:45.679: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:47.718: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:49.755: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:51.793: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:53.831: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:55.868: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:57.909: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:12:59.946: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:01.983: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:04.020: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:06.058: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:08.098: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:10.135: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:12.172: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:14.210: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:16.293: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:18.331: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:20.369: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:22.407: INFO: VolumeSnapshot snapshot-4mjlh found but is not ready. Jun 19 06:13:24.408: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 19 06:13:24.408: INFO: Unexpected error: <*errors.errorString | 0xc002706660>: { s: "VolumeSnapshot snapshot-4mjlh is not ready within 5m0s", } Jun 19 06:13:24.409: FAIL: VolumeSnapshot snapshot-4mjlh is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc0021e09c8?}, 0xc0021e11f0) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage/framework.CreateSnapshotResource({0x7f9d66ee2f18, 0xc0022b9860}, 0xc004517200, {{0x71fffd4, 0x28}, {0x0, 0x0}, {0x713ca0a, 0x9}, {0x0, ...}, ...}, ...) test/e2e/storage/framework/snapshot_resource.go:92 +0x246 k8s.io/kubernetes/test/e2e/storage.glob..func1.21.1() test/e2e/storage/csi_mock_volume.go:1956 +0xb34 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: updating the snapshot content deletion policy to retain �[1mSTEP�[0m: Deleting storageclass csi-mock-volumes-23459528d �[1mSTEP�[0m: Cleaning up resources �[1mSTEP�[0m: deleting the test namespace: csi-mock-volumes-2345 �[1mSTEP�[0m: Waiting for namespaces [csi-mock-volumes-2345] to vanish �[1mSTEP�[0m: uninstalling csi mock driver Jun 19 06:16:58.535: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-2345-874/csi-attacher Jun 19 06:16:58.637: INFO: deleting *v1.ClusterRole: external-attacher-runner-csi-mock-volumes-2345 Jun 19 06:16:58.737: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-csi-mock-volumes-2345 Jun 19 06:16:58.837: INFO: deleting *v1.Role: csi-mock-volumes-2345-874/external-attacher-cfg-csi-mock-volumes-2345 Jun 19 06:16:58.937: INFO: deleting *v1.RoleBinding: csi-mock-volumes-2345-874/csi-attacher-role-cfg Jun 19 06:16:59.037: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-2345-874/csi-provisioner Jun 19 06:16:59.138: INFO: deleting *v1.ClusterRole: external-provisioner-runner-csi-mock-volumes-2345 Jun 19 06:16:59.239: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-csi-mock-volumes-2345 Jun 19 06:16:59.338: INFO: deleting *v1.Role: csi-mock-volumes-2345-874/external-provisioner-cfg-csi-mock-volumes-2345 Jun 19 06:16:59.438: INFO: deleting *v1.RoleBinding: csi-mock-volumes-2345-874/csi-provisioner-role-cfg Jun 19 06:16:59.537: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-2345-874/csi-resizer Jun 19 06:16:59.638: INFO: deleting *v1.ClusterRole: external-resizer-runner-csi-mock-volumes-2345 Jun 19 06:16:59.739: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-csi-mock-volumes-2345 Jun 19 06:16:59.839: INFO: deleting *v1.Role: csi-mock-volumes-2345-874/external-resizer-cfg-csi-mock-volumes-2345 Jun 19 06:16:59.937: INFO: deleting *v1.RoleBinding: csi-mock-volumes-2345-874/csi-resizer-role-cfg Jun 19 06:17:00.040: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-2345-874/csi-snapshotter Jun 19 06:17:00.138: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-csi-mock-volumes-2345 Jun 19 06:17:00.238: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-csi-mock-volumes-2345 Jun 19 06:17:00.337: INFO: deleting *v1.Role: csi-mock-volumes-2345-874/external-snapshotter-leaderelection-csi-mock-volumes-2345 Jun 19 06:17:00.437: INFO: deleting *v1.RoleBinding: csi-mock-volumes-2345-874/external-snapshotter-leaderelection Jun 19 06:17:00.538: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-2345-874/csi-mock Jun 19 06:17:00.637: INFO: deleting *v1.ClusterRoleBinding: csi-controller-attacher-role-csi-mock-volumes-2345 Jun 19 06:17:00.737: INFO: deleting *v1.ClusterRoleBinding: csi-controller-provisioner-role-csi-mock-volumes-2345 Jun 19 06:17:00.837: INFO: deleting *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-csi-mock-volumes-2345 Jun 19 06:17:00.937: INFO: deleting *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-csi-mock-volumes-2345 Jun 19 06:17:01.039: INFO: deleting *v1.ClusterRoleBinding: csi-controller-resizer-role-csi-mock-volumes-2345 Jun 19 06:17:01.138: INFO: deleting *v1.ClusterRoleBinding: csi-controller-snapshotter-role-csi-mock-volumes-2345 Jun 19 06:17:01.238: INFO: deleting *v1.StorageClass: csi-mock-sc-csi-mock-volumes-2345 Jun 19 06:17:01.338: INFO: deleting *v1.StatefulSet: csi-mock-volumes-2345-874/csi-mockplugin Jun 19 06:17:01.439: INFO: deleting *v1.CSIDriver: csi-mock-csi-mock-volumes-2345 Jun 19 06:17:01.537: INFO: deleting *v1.StatefulSet: csi-mock-volumes-2345-874/csi-mockplugin-snapshotter �[1mSTEP�[0m: deleting the driver namespace: csi-mock-volumes-2345-874 �[1mSTEP�[0m: Waiting for namespaces [csi-mock-volumes-2345-874] to vanish [AfterEach] [sig-storage] CSI mock volume test/e2e/framework/framework.go:187 Jun 19 06:17:07.820: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\smock\svolume\sCSI\sVolume\sSnapshots\s\[Feature\:VolumeSnapshotDataSource\]\svolumesnapshotcontent\sand\spvc\sin\sBound\sstate\swith\sdeletion\stimestamp\sset\sshould\snot\sget\sdeleted\swhile\ssnapshot\sfinalizer\sexists$'
test/e2e/storage/csi_mock_volume.go:1464 Jun 19 07:43:03.613: VolumeSnapshot snapshot-jj29x is not ready within 5m0s test/e2e/storage/utils/snapshot.go:86from junit_01.xml
[BeforeEach] [sig-storage] CSI mock volume test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 19 07:37:49.129: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename csi-mock-volumes �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] volumesnapshotcontent and pvc in Bound state with deletion timestamp set should not get deleted while snapshot finalizer exists test/e2e/storage/csi_mock_volume.go:1464 �[1mSTEP�[0m: Building a driver namespace object, basename csi-mock-volumes-2981 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi mock proxy Jun 19 07:37:49.717: INFO: creating *v1.ServiceAccount: csi-mock-volumes-2981-3116/csi-attacher Jun 19 07:37:49.754: INFO: creating *v1.ClusterRole: external-attacher-runner-csi-mock-volumes-2981 Jun 19 07:37:49.754: INFO: Define cluster role external-attacher-runner-csi-mock-volumes-2981 Jun 19 07:37:49.789: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-csi-mock-volumes-2981 Jun 19 07:37:49.825: INFO: creating *v1.Role: csi-mock-volumes-2981-3116/external-attacher-cfg-csi-mock-volumes-2981 Jun 19 07:37:49.862: INFO: creating *v1.RoleBinding: csi-mock-volumes-2981-3116/csi-attacher-role-cfg Jun 19 07:37:49.898: INFO: creating *v1.ServiceAccount: csi-mock-volumes-2981-3116/csi-provisioner Jun 19 07:37:49.934: INFO: creating *v1.ClusterRole: external-provisioner-runner-csi-mock-volumes-2981 Jun 19 07:37:49.934: INFO: Define cluster role external-provisioner-runner-csi-mock-volumes-2981 Jun 19 07:37:49.973: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-csi-mock-volumes-2981 Jun 19 07:37:50.010: INFO: creating *v1.Role: csi-mock-volumes-2981-3116/external-provisioner-cfg-csi-mock-volumes-2981 Jun 19 07:37:50.047: INFO: creating *v1.RoleBinding: csi-mock-volumes-2981-3116/csi-provisioner-role-cfg Jun 19 07:37:50.084: INFO: creating *v1.ServiceAccount: csi-mock-volumes-2981-3116/csi-resizer Jun 19 07:37:50.121: INFO: creating *v1.ClusterRole: external-resizer-runner-csi-mock-volumes-2981 Jun 19 07:37:50.121: INFO: Define cluster role external-resizer-runner-csi-mock-volumes-2981 Jun 19 07:37:50.157: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-csi-mock-volumes-2981 Jun 19 07:37:50.194: INFO: creating *v1.Role: csi-mock-volumes-2981-3116/external-resizer-cfg-csi-mock-volumes-2981 Jun 19 07:37:50.230: INFO: creating *v1.RoleBinding: csi-mock-volumes-2981-3116/csi-resizer-role-cfg Jun 19 07:37:50.267: INFO: creating *v1.ServiceAccount: csi-mock-volumes-2981-3116/csi-snapshotter Jun 19 07:37:50.303: INFO: creating *v1.ClusterRole: external-snapshotter-runner-csi-mock-volumes-2981 Jun 19 07:37:50.303: INFO: Define cluster role external-snapshotter-runner-csi-mock-volumes-2981 Jun 19 07:37:50.340: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-csi-mock-volumes-2981 Jun 19 07:37:50.376: INFO: creating *v1.Role: csi-mock-volumes-2981-3116/external-snapshotter-leaderelection-csi-mock-volumes-2981 Jun 19 07:37:50.412: INFO: creating *v1.RoleBinding: csi-mock-volumes-2981-3116/external-snapshotter-leaderelection Jun 19 07:37:50.449: INFO: creating *v1.ServiceAccount: csi-mock-volumes-2981-3116/csi-mock Jun 19 07:37:50.485: INFO: creating *v1.ClusterRoleBinding: csi-controller-attacher-role-csi-mock-volumes-2981 Jun 19 07:37:50.522: INFO: creating *v1.ClusterRoleBinding: csi-controller-provisioner-role-csi-mock-volumes-2981 Jun 19 07:37:50.558: INFO: creating *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-csi-mock-volumes-2981 Jun 19 07:37:50.594: INFO: creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-csi-mock-volumes-2981 Jun 19 07:37:50.631: INFO: creating *v1.ClusterRoleBinding: csi-controller-resizer-role-csi-mock-volumes-2981 Jun 19 07:37:50.668: INFO: creating *v1.ClusterRoleBinding: csi-controller-snapshotter-role-csi-mock-volumes-2981 Jun 19 07:37:50.704: INFO: creating *v1.StorageClass: csi-mock-sc-csi-mock-volumes-2981 Jun 19 07:37:50.745: INFO: creating *v1.StatefulSet: csi-mock-volumes-2981-3116/csi-mockplugin Jun 19 07:37:50.785: INFO: creating *v1.CSIDriver: csi-mock-csi-mock-volumes-2981 Jun 19 07:37:50.842: INFO: creating *v1.StatefulSet: csi-mock-volumes-2981-3116/csi-mockplugin-snapshotter Jun 19 07:37:50.879: INFO: waiting up to 4m0s for CSIDriver "csi-mock-csi-mock-volumes-2981" Jun 19 07:37:50.917: INFO: waiting for CSIDriver csi-mock-csi-mock-volumes-2981 to register on node bootstrap-e2e-minion-group-v98m �[1mSTEP�[0m: Creating storage class �[1mSTEP�[0m: Creating snapshot �[1mSTEP�[0m: creating a SnapshotClass �[1mSTEP�[0m: creating a dynamic VolumeSnapshot �[1mSTEP�[0m: Creating PVC csi-mock-volumes-2981/snapshot-test-pvc �[1mSTEP�[0m: Wait for finalizer to be added to claim csi-mock-volumes-2981/snapshot-test-pvc Jun 19 07:38:00.769: INFO: Waiting up to 1m0s for PersistentVolumeClaim csi-mock-volumes-2981/snapshot-test-pvc to contain finalizer snapshot.storage.kubernetes.io/pvc-as-source-protection Jun 19 07:38:01.788: INFO: WaitUntil finished successfully after 1.018641952s �[1mSTEP�[0m: Wait for PVC to be Bound Jun 19 07:38:01.788: INFO: Waiting up to timeout=1m0s for PersistentVolumeClaims [snapshot-test-pvc] to have phase Bound Jun 19 07:38:01.836: INFO: PersistentVolumeClaim snapshot-test-pvc found and phase=Bound (48.05077ms) �[1mSTEP�[0m: Delete PVC snapshot-test-pvc Jun 19 07:38:01.907: INFO: Deleting PersistentVolumeClaim "snapshot-test-pvc" �[1mSTEP�[0m: Get PVC from API server and verify deletion timestamp is set �[1mSTEP�[0m: Get VolumeSnapshotContent bound to VolumeSnapshot snapshot-jj29x Jun 19 07:38:01.992: INFO: Waiting up to 5m0s for VolumeSnapshot snapshot-jj29x to become ready Jun 19 07:38:02.028: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:04.064: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:06.104: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:08.141: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:10.178: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:12.215: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:14.252: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:16.294: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:18.331: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:20.368: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:22.406: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:24.444: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:26.481: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:28.518: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:30.554: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:32.591: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:34.629: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:36.666: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:38.703: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:40.741: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:42.778: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:44.818: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:46.854: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:48.892: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:50.928: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:52.966: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:55.003: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:57.054: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:38:59.091: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:01.128: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:03.165: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:05.202: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:07.255: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:09.292: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:11.329: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:13.366: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:15.404: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:17.449: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:19.484: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:21.522: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:23.559: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:25.596: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:27.633: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:29.670: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:31.707: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:33.744: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:35.781: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:37.822: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:39.859: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:41.895: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:43.933: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:45.970: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:48.008: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:50.045: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:52.083: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:54.120: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:56.157: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:39:58.195: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:00.231: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:02.268: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:04.306: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:06.343: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:08.381: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:10.419: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:12.458: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:14.496: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:16.563: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:18.599: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:20.637: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:22.674: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:24.711: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:26.749: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:28.786: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:30.822: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:32.860: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:34.897: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:36.933: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:38.970: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:41.007: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:43.045: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:45.082: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:47.119: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:49.156: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:51.194: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:53.231: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:55.271: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:57.308: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:40:59.346: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:01.383: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:03.423: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:05.460: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:07.498: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:09.535: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:11.573: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:13.610: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:15.647: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:17.685: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:19.721: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:21.759: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:23.796: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:25.832: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:27.870: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:29.908: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:31.945: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:33.981: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:36.019: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:38.057: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:40.095: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:42.133: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:44.177: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:46.215: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:48.251: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:50.289: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:52.326: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:54.362: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:56.399: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:41:58.436: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:00.474: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:02.512: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:04.550: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:06.587: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:08.624: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:10.662: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:12.705: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:14.743: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:16.780: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:18.823: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:20.861: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:22.899: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:24.935: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:26.973: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:29.010: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:31.046: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:33.083: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:35.121: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:37.159: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:39.196: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:41.234: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:43.273: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:45.310: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:47.349: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:49.387: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:51.424: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:53.460: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:55.497: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:57.537: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:42:59.574: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:43:01.611: INFO: VolumeSnapshot snapshot-jj29x found but is not ready. Jun 19 07:43:03.612: INFO: WaitUntil failed after reaching the timeout 5m0s Jun 19 07:43:03.612: INFO: Unexpected error: <*errors.errorString | 0xc003c69290>: { s: "VolumeSnapshot snapshot-jj29x is not ready within 5m0s", } Jun 19 07:43:03.613: FAIL: VolumeSnapshot snapshot-jj29x is not ready within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.GetSnapshotContentFromSnapshot({0x79f48c0, 0xc0031043f0?}, 0xc0021e11c8) test/e2e/storage/utils/snapshot.go:86 +0x1ad k8s.io/kubernetes/test/e2e/storage.glob..func1.16.2() test/e2e/storage/csi_mock_volume.go:1531 +0xcee k8s.io/kubernetes/test/e2e.RunE2ETests(0x2565617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000b54a80?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0007f2d00, 0x73dfc40) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting storageclass csi-mock-volumes-298188pmc �[1mSTEP�[0m: Deleting volumesnapshotclass csi-mock-volumes-2981msjct �[1mSTEP�[0m: Cleaning up resources �[1mSTEP�[0m: deleting the test namespace: csi-mock-volumes-2981 �[1mSTEP�[0m: Waiting for namespaces [csi-mock-volumes-2981] to vanish �[1mSTEP�[0m: uninstalling csi mock driver Jun 19 07:43:20.981: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-2981-3116/csi-attacher Jun 19 07:43:21.018: INFO: deleting *v1.ClusterRole: external-attacher-runner-csi-mock-volumes-2981 Jun 19 07:43:21.056: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-csi-mock-volumes-2981 Jun 19 07:43:21.096: INFO: deleting *v1.Role: csi-mock-volumes-2981-3116/external-attacher-cfg-csi-mock-volumes-2981 Jun 19 07:43:21.153: INFO: deleting *v1.RoleBinding: csi-mock-volumes-2981-3116/csi-attacher-role-cfg Jun 19 07:43:21.191: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-2981-3116/csi-provisioner Jun 19 07:43:21.230: INFO: deleting *v1.ClusterRole: external-provisioner-runner-csi-mock-volumes-2981 Jun 19 07:43:21.270: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-csi-mock-volumes-2981 Jun 19 07:43:21.307: INFO: deleting *v1.Role: csi-mock-volumes-2981-3116/external-provisioner-cfg-csi-mock-volumes-2981 Jun 19 07:43:21.345: INFO: deleting *v1.RoleBinding: csi-mock-volumes-2981-3116/csi-provisioner-role-cfg Jun 19 07:43:21.381: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-2981-3116/csi-resizer Jun 19 07:43:21.418: INFO: deleting *v1.ClusterRole: external-resizer-runner-csi-mock-volumes-2981 Jun 19 07:43:21.455: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-csi-mock-volumes-2981 Jun 19 07:43:21.491: INFO: deleting *v1.Role: csi-mock-volumes-2981-3116/external-resizer-cfg-csi-mock-volumes-2981 Jun 19 07:43:21.528: INFO: deleting *v1.RoleBinding: csi-mock-volumes-2981-3116/csi-resizer-role-cfg Jun 19 07:43:21.565: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-2981-3116/csi-snapshotter Jun 19 07:43:21.601: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-csi-mock-volumes-2981 Jun 19 07:43:21.637: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-csi-mock-volumes-2981 Jun 19 07:43:21.673: INFO: deleting *v1.Role: csi-mock-volumes-2981-3116/external-snapshotter-leaderelection-csi-mock-volumes-2981 Jun 19 07:43:21.710: INFO: deleting *v1.RoleBinding: csi-mock-volumes-2981-3116/external-snapshotter-leaderelection Jun 19 07:43:21.746: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-2981-3116/csi-mock Jun 19 07:43:21.782: INFO: deleting *v1.ClusterRoleBinding: csi-controller-attacher-role-csi-mock-volumes-2981 Jun 19 07:43:21.830: INFO: deleting *v1.ClusterRoleBinding: csi-controller-provisioner-role-csi-mock-volumes-2981 Jun 19 07:43:21.868: INFO: deleting *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-csi-mock-volumes-2981 Jun 19 07:43:21.905: INFO: deleting *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-csi-mock-volumes-2981 Jun 19 07:43:21.941: INFO: deleting *v1.ClusterRoleBinding: csi-controller-resizer-role-csi-mock-volumes-2981 Jun 19 07:43:21.978: INFO: deleting *v1.ClusterRoleBinding: csi-controller-snapshotter-role-csi-mock-volumes-2981 Jun 19 07:43:22.015: INFO: deleting *v1.StorageClass: csi-mock-sc-csi-mock-volumes-2981 Jun 19 07:43:22.053: INFO: deleting *v1.StatefulSet: csi-mock-volumes-2981-3116/csi-mockplugin Jun 19 07:43:22.090: INFO: deleting *v1.CSIDriver: csi-mock-csi-mock-volumes-2981 Jun 19 07:43:22.174: INFO: deleting *v1.StatefulSet: csi-mock-volumes-2981-3116/csi-mockplugin-snapshotter �[1mSTEP�[0m: deleting the driver namespace: csi-mock-volumes-2981-3116 �[1mSTEP�[0m: Waiting for namespaces [csi-mock-volumes-2981-3116] to vanish [AfterEach] [sig-storage] CSI mock volume test/e2e/framework/framework.go:187 Jun 19 07:44:06.368: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:VolumeSnapshotDataSource\] --ginkgo.skip=\[Disruptive\]|\[Flaky\] --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true (interrupted): exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest --timeout triggered
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest Check APIReachability
kubetest Deferred TearDown
kubetest DumpClusterLogs
kubetest Extract
kubetest GetDeployer
kubetest IsUp
kubetest Prepare
kubetest TearDown
kubetest TearDown Previous
kubetest Up
kubetest diffResources
kubetest kubectl version
kubetest list nodes
kubetest listResources After
kubetest listResources Before
kubetest listResources Down
kubetest listResources Up
kubetest test setup
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing mutating webhooks should work [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a validating webhook should work [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny custom resource creation, update and deletion [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with pruning [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin] CustomResourceDefinition Watch watch on custom resource definition objects [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition creating/deleting custom resource definition objects works [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group and version but different kinds [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should delete jobs and pods created by cronjob
Kubernetes e2e suite [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's multiple priority class scope (quota set to pod count: 2) against 2 pods with same priority classes.
Kubernetes e2e suite [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against a pod with same priority class.
Kubernetes e2e suite [sig-api-machinery] ResourceQuota [Feature:ScopeSelectors] should verify ResourceQuota with best effort scope using scope-selectors.
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a persistent volume claim
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a persistent volume claim with a storage class
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a pod. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ServerSideApply should remove a field if it is owned but removed in the apply request
Kubernetes e2e suite [sig-api-machinery] Servers with support for Table transformation should return a 406 for a backend which does not implement metadata [Conformance]
Kubernetes e2e suite [sig-api-machinery] StorageVersion resources [Feature:StorageVersionAPI] storage version with non-existing id should be GC'ed
Kubernetes e2e suite [sig-api-machinery] server version should find the server version [Conformance]
Kubernetes e2e suite [sig-apps] CronJob should delete successful finished jobs with limit of one successful job
Kubernetes e2e suite [sig-apps] Daemon set [Serial] should rollback without unnecessary restarts [Conformance]
Kubernetes e2e suite [sig-apps] DaemonRestart [Disruptive] Controller Manager should not create/delete replicas across restart
Kubernetes e2e suite [sig-apps] Deployment iterative rollouts should eventually progress
Kubernetes e2e suite [sig-apps] Deployment should not disrupt a cloud load-balancer's connectivity during rollout
Kubernetes e2e suite [sig-apps] DisruptionController evictions: maxUnavailable allow single eviction, percentage => should allow an eviction
Kubernetes e2e suite [sig-apps] DisruptionController should block an eviction until the PDB is updated to allow it [Conformance]
Kubernetes e2e suite [sig-apps] DisruptionController should observe that the PodDisruptionBudget status is not updated for unmanaged pods
Kubernetes e2e suite [sig-apps] Job should apply changes to a job status [Conformance]
Kubernetes e2e suite [sig-apps] ReplicaSet Replace and Patch tests [Conformance]
Kubernetes e2e suite [sig-apps] ReplicaSet should validate Replicaset Status endpoints [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Scaling should happen in predictable order and halt if any stateful pod is unhealthy [Slow] [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should implement legacy replacement when the update strategy is OnDelete
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should list, patch and delete a collection of StatefulSets [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet MinReadySeconds should be honored when enabled
Kubernetes e2e suite [sig-apps] StatefulSet Non-retain StatefulSetPersistentVolumeClaimPolicy [Feature:StatefulSetAutoDeletePVC] should delete PVCs with a WhenDeleted policy
Kubernetes e2e suite [sig-apps] stateful Upgrade [Feature:StatefulUpgrade] stateful upgrade should maintain a functioning cluster
Kubernetes e2e suite [sig-auth] ServiceAccounts should mount projected service account token [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts should support InClusterConfig with token rotation [Slow]
Kubernetes e2e suite [sig-auth] [Feature:NodeAuthorizer] Getting a non-existent configmap should exit with the Forbidden error, not a NotFound error
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaler scalability [Slow] CA ignores unschedulable pods while scheduling schedulable pods [Feature:ClusterAutoscalerScalability6]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] Should be able to scale a node group up from 0[Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] Should scale down GPU pool from 1 [GpuType:] [Feature:ClusterSizeAutoscalingGpu]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] should be able to scale down by draining system pods with pdb[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] should correctly scale down after a node is not needed and one node is broken [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pending pods are small and there is another node pool that is not autoscaled [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pod requesting volume is pending [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't be able to scale down when rescheduling a pod is required, but pdb doesn't allow drain[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't scale down when non expendable pod is running [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't scale up when expendable pod is created [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't trigger additional scale-ups during processing scale-up [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicaSet Should scale from 5 pods to 3 pods and from 3 to 1
Kubernetes e2e suite [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicaSet with idle sidecar (ContainerResource use case) Should not scale up on a busy sidecar with an idle application
Kubernetes e2e suite [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicationController Should scale from 1 pod to 3 pods and from 3 to 5 and verify decision stability
Kubernetes e2e suite [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicationController Should scale from 5 pods to 3 pods and from 3 to 1 and verify decision stability
Kubernetes e2e suite [sig-autoscaling] [HPA] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) should scale down with Custom Metric of type Object from Stackdriver [Feature:CustomMetricsAutoscaling]
Kubernetes e2e suite [sig-autoscaling] [HPA] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) should scale up with two External metrics from Stackdriver [Feature:CustomMetricsAutoscaling]
Kubernetes e2e suite [sig-autoscaling] [HPA] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) should scale up with two metrics of type Pod from Stackdriver [Feature:CustomMetricsAutoscaling]
Kubernetes e2e suite [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects a client request should support a client that connects, sends NO DATA, and disconnects
Kubernetes e2e suite [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects a client request should support a client that connects, sends NO DATA, and disconnects
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl cluster-info should check if Kubernetes control plane services is included in cluster-info [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl label should update the label on a resource [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl run pod should create a pod from an image when restart is Never [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl server-side dry-run should check if kubectl can dry-run update Pods [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl validation should create/apply a valid CR for CRD with validation schema
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl version should check is all data is printed [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a successful command
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should return command exit codes running a failing command
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support exec through an HTTP proxy
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support exec through kubectl proxy
Kubernetes e2e suite [sig-cloud-provider-gcp] Downgrade [Feature:Downgrade] cluster downgrade should maintain a functioning cluster [Feature:ClusterDowngrade]
Kubernetes e2e suite [sig-cloud-provider-gcp] GKE node pools [Feature:GKENodePool] should create a cluster with multiple node pools [Feature:GKENodePool]
Kubernetes e2e suite [sig-cloud-provider-gcp] HA-master [Feature:HAMaster] survive addition/removal replicas different zones [Serial][Disruptive]
Kubernetes e2e suite [sig-cloud-provider-gcp] Nodes [Disruptive] Resize [Slow] should be able to delete nodes
Kubernetes e2e suite [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] each node by dropping all outbound packets for a while and ensure they function afterwards
Kubernetes e2e suite [sig-cloud-provider-gcp] Restart [Disruptive] should restart all nodes and ensure all nodes and pods recover
Kubernetes e2e suite [sig-cluster-lifecycle] [Feature:BootstrapTokens] should delete the token secret when the secret expired
Kubernetes e2e suite [sig-cluster-lifecycle] [Feature:BootstrapTokens] should sign the new added bootstrap tokens
Kubernetes e2e suite [sig-instrumentation] Stackdriver Monitoring should have accelerator metrics [Feature:StackdriverAcceleratorMonitoring]
Kubernetes e2e suite [sig-instrumentation] Stackdriver Monitoring should run Custom Metrics - Stackdriver Adapter for external metrics [Feature:StackdriverExternalMetrics]
Kubernetes e2e suite [sig-instrumentation] Stackdriver Monitoring should run Custom Metrics - Stackdriver Adapter for old resource model [Feature:StackdriverCustomMetrics]
Kubernetes e2e suite [sig-instrumentation] Stackdriver Monitoring should run Stackdriver Metadata Agent [Feature:StackdriverMetadataAgent]
Kubernetes e2e suite [sig-network] ClusterDns [Feature:Example] should create pod that uses dns
Kubernetes e2e suite [sig-network] DNS should provide DNS for the cluster [Provider:GCE]
Kubernetes e2e suite [sig-network] DNS should resolve DNS of partial qualified names for services [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] DNS should support configurable pod resolv.conf
Kubernetes e2e suite [sig-network] EndpointSlice should support creating EndpointSlice API operations [Conformance]
Kubernetes e2e suite [sig-network] Firewall rule [Slow] [Serial] should create valid firewall rules for LoadBalancer type service
Kubernetes e2e suite [sig-network] Firewall rule control plane should not expose well-known ports
Kubernetes e2e suite [sig-network] Ingress API should support creating Ingress API operations [Conformance]
Kubernetes e2e suite [sig-network] IngressClass [Feature:Ingress] should allow IngressClass to have Namespace-scoped parameters [Serial]
Kubernetes e2e suite [sig-network] IngressClass [Feature:Ingress] should prevent Ingress creation if more than 1 IngressClass marked as default [Serial]
Kubernetes e2e suite [sig-network] LoadBalancers should be able to change the type and ports of a UDP service [Slow]
Kubernetes e2e suite [sig-network] LoadBalancers should have session affinity work for LoadBalancer service with ESIPP off [Slow] [DisabledForLargeClusters] [LinuxOnly]
Kubernetes e2e suite [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:Ingress] should conform to Ingress spec
Kubernetes e2e suite [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] [Flaky] should sync endpoints to NEG
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should allow egress access on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should allow ingress access on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should enforce ingress policy allowing any port traffic to a server on a specific protocol [Feature:NetworkPolicy] [Feature:UDP]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should enforce multiple ingress policies with ingress allow-all policy taking precedence [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on NamespaceSelector with MatchExpressions using default ns label [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should not mistakenly treat 'protocol: SCTP' as 'protocol: TCP', even if the plugin doesn't support SCTP [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should properly isolate pods that are selected by a policy allowing SCTP, even if the plugin doesn't support SCTP [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol NetworkPolicy between server and client should support a 'default-deny-all' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Netpol [Feature:SCTPConnectivity][LinuxOnly][Disruptive] NetworkPolicy between server and client using SCTP should support a 'default-deny-ingress' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicy [Feature:SCTPConnectivity][LinuxOnly][Disruptive] NetworkPolicy between server and client using SCTP should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow ingress access from updated pod [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce multiple egress policies with egress allow-all policy taking precedence [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on PodSelector or NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on PodSelector with MatchExpressions[Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce updated policy [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should not allow access by TCP when a policy specifies only SCTP [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should support a 'default-deny-all' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should be able to handle large requests: udp
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for client IP based session affinity: http [LinuxOnly]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for client IP based session affinity: udp [LinuxOnly]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for endpoint-Service: http
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for endpoint-Service: sctp [Feature:SCTPConnectivity][Disruptive]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for endpoint-Service: udp
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for node-Service: http
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should update endpoints: http
Kubernetes e2e suite [sig-network] Networking should check kube-proxy urls
Kubernetes e2e suite [sig-network] Networking should provide Internet connection for containers [Feature:Networking-IPv4]
Kubernetes e2e suite [sig-network] Networking should provide unchanging, static URL paths for kubernetes api services
Kubernetes e2e suite [sig-network] Networking should provider Internet connection for containers using DNS [Feature:Networking-DNS]
Kubernetes e2e suite [sig-network] NoSNAT [Feature:NoSNAT] [Slow] Should be able to send traffic between Pods without SNAT
Kubernetes e2e suite [sig-network] Proxy version v1 A set of valid responses are returned for both pod and service ProxyWithPath [Conformance]
Kubernetes e2e suite [sig-network] Proxy version v1 should proxy logs on node using proxy subresource
Kubernetes e2e suite [sig-network] Proxy version v1 should proxy logs on node with explicit kubelet port using proxy subresource
Kubernetes e2e suite [sig-network] SCTP [LinuxOnly] should create a Pod with SCTP HostPort
Kubernetes e2e suite [sig-network] Services should be able to up and down services
Kubernetes e2e suite [sig-network] Services should have session affinity work for service with type clusterIP [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] Services should provide secure master service [Conformance]
Kubernetes e2e suite [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for node-Service: udp
Kubernetes e2e suite [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for pod-Service: sctp [Feature:SCTPConnectivity][Disruptive]
Kubernetes e2e suite [sig-network] [Feature:IPv6DualStack] should be able to reach pod on ipv4 and ipv6 ip
Kubernetes e2e suite [sig-network] [Feature:PerformanceDNS][Serial] Should answer DNS query for maximum number of services per cluster
Kubernetes e2e suite [sig-network] kube-proxy migration [Feature:KubeProxyDaemonSetMigration] Upgrade kube-proxy from static pods to a DaemonSet should maintain a functioning cluster [Feature:KubeProxyDaemonSetUpgrade]
Kubernetes e2e suite [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart exec hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test on terminated container should report termination message as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull from private registry with secret [NodeConformance]
Kubernetes e2e suite [sig-node] Containers should be able to override the image's default arguments (container cmd) [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Containers should be able to override the image's default command and arguments [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Ephemeral Containers [NodeFeature:EphemeralContainers] will start an ephemeral container in an existing pod
Kubernetes e2e suite [sig-node] Events should be sent by kubelets and the scheduler about pods scheduling and running
Kubernetes e2e suite [sig-node] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]
Kubernetes e2e suite [sig-node] InitContainer [NodeConformance] should invoke init containers on a RestartNever pod [Conformance]
Kubernetes e2e suite [sig-node] Kubelet [Serial] [Slow] experimental resource usage tracking [Feature:ExperimentalResourceUsageTracking] resource tracking for 100 pods per node
Kubernetes e2e suite [sig-node] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] PodTemplates should run the lifecycle of PodTemplates [Conformance]
Kubernetes e2e suite [sig-node] Pods Extended Pod Container lifecycle should not create extra sandbox if all containers are done
Kubernetes e2e suite [sig-node] Pods Extended Pods Set QOS Class should be set on Pods with matching resource requests and limits for memory and cpu [Conformance]
Kubernetes e2e suite [sig-node] Pods should contain environment variables for services [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Pods should get a host IP [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Pods should have their auto-restart back-off timer reset on image update [Slow][NodeConformance]
Kubernetes e2e suite [sig-node] PrivilegedPod [NodeConformance] should enable privileged commands [LinuxOnly]
Kubernetes e2e suite [sig-node] Probing container should *not* be restarted by liveness probe because startup probe delays it
Kubernetes e2e suite [sig-node] Probing container should *not* be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should be restarted with a GRPC liveness probe [NodeConformance]
Kubernetes e2e suite [sig-node] Probing container should not be ready with an exec readiness probe timeout [MinimumKubeletVersion:1.20] [NodeConformance]
Kubernetes e2e suite [sig-node] RuntimeClass should reject a Pod requesting a RuntimeClass with an unconfigured handler [NodeFeature:RuntimeHandler]
Kubernetes e2e suite [sig-node] RuntimeClass should reject a Pod requesting a RuntimeClass with conflicting node selector
Kubernetes e2e suite [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler]
Kubernetes e2e suite [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with scheduling with taints [Serial]
Kubernetes e2e suite [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with scheduling without taints
Kubernetes e2e suite [sig-node] Security Context When creating a container with runAsNonRoot should run with an explicit non-root user ID [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Security Context should support container.SecurityContext.RunAsUser [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context should support pod.Spec.SecurityContext.RunAsUser [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context should support seccomp unconfined on the pod [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context should support volume SELinux relabeling when using hostPID [Flaky] [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Variable Expansion should allow substituting values in a container's command [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Variable Expansion should allow substituting values in a volume subpath [Conformance]
Kubernetes e2e suite [sig-node] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [Slow] [Conformance]
Kubernetes e2e suite [sig-node] [Feature:Example] Downward API should create a pod that prints his name and namespace
Kubernetes e2e suite [sig-scheduling] Multi-AZ Clusters should spread the pods of a replication controller across zones [Serial]
Kubernetes e2e suite [sig-scheduling] SchedulerPredicates [Serial] validates that NodeAffinity is respected if not matching
Kubernetes e2e suite [sig-scheduling] SchedulerPreemption [Serial] validates basic preemption works [Conformance]
Kubernetes e2e suite [sig-scheduling] SchedulerPriorities [Serial] Pod should be scheduled to node that don't match the PodAntiAffinity terms
Kubernetes e2e suite [sig-scheduling] [Feature:GPUDevicePlugin] run Nvidia GPU Device Plugin tests
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] volume-lifecycle-performance should provision volumes at scale within performance constraints [Slow] [Serial]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Ephemeral Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] capacity provides storage capacity information
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (filesystem volmode)] volume-lifecycle-performance should provision volumes at scale within performance constraints [Slow] [Serial]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directory
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (xfs)][Slow] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Ephemeral Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Ephemeral Snapshot (retain policy)] snapshottable[Feature:VolumeSnapshotDataSource] volume snapshot controller should check snapshot fields, check restore correctly works after modifying source data, check deletion (persistent)
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] CSI mock volume CSI CSIDriver deployment after pod creation using non-attachable mock driver should bringup pod after deploying CSIDriver attach=false [Slow]
Kubernetes e2e suite [sig-storage] CSI mock volume CSI NodeStage error cases [Slow] should call NodeUnstage after NodeStage ephemeral error
Kubernetes e2e suite [sig-storage] CSI mock volume CSI Volume expansion should expand volume by restarting pod if attach=off, nodeExpansion=on
Kubernetes e2e suite [sig-storage] CSI mock volume CSIServiceAccountToken token should be plumbed down when csiServiceAccountTokenEnabled=true
Kubernetes e2e suite [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity used, have capacity
Kubernetes e2e suite [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity used, no capacity
Kubernetes e2e suite [sig-storage] ConfigMap Should fail non-optional pod creation due to configMap object does not exist [Slow]
Kubernetes e2e suite [sig-storage] ConfigMap Should fail non-optional pod creation due to the key in the configMap object does not exist [Slow]
Kubernetes e2e suite [sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] ConfigMap optional updates should be reflected in volume [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] ConfigMap should be consumable from pods in volume as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]
Kubernetes e2e suite [sig-storage] ConfigMap should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeFeature:FSGroup]
Kubernetes e2e suite [sig-storage] ConfigMap should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] Downward API [Serial] [Disruptive] [Feature:EphemeralStorage] Downward API tests for local ephemeral storage should provide default limits.ephemeral-storage from node allocatable
Kubernetes e2e suite [sig-storage] Downward API volume should provide container's memory limit [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] Downward API volume should provide node allocatable (cpu) as default cpu limit if the limit is not set [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] Downward API volume should provide podname as non-root with fsgroup [LinuxOnly] [NodeFeature:FSGroup]
Kubernetes e2e suite [sig-storage] Downward API volume should provide podname only [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] Downward API volume should update annotations on modification [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] Dynamic Provisioning DynamicProvisioner Default should be disabled by removing the default annotation [Serial] [Disruptive]
Kubernetes e2e suite [sig-storage] Dynamic Provisioning DynamicProvisioner [Slow] [Feature:StorageProvider] should provision storage with non-default reclaim policy Retain
Kubernetes e2e suite [sig-storage] Dynamic Provisioning DynamicProvisioner [Slow] [Feature:StorageProvider] should test that deleting a claim before the volume is provisioned deletes the volume.
Kubernetes e2e suite [sig-storage] EmptyDir volumes should support (non-root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] EmptyDir volumes should support (root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] files with FSGroup ownership should support (root,0644,tmpfs)
Kubernetes e2e suite [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] new files should be created with FSGroup ownership when container is non-root
Kubernetes e2e suite [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] volume on default medium should have the correct mode using FSGroup
Kubernetes e2e suite [sig-storage] EmptyDir wrapper volumes should not cause race condition when used for git_repo [Serial] [Slow]
Kubernetes e2e suite [sig-storage] EmptyDir wrapper volumes should not conflict [Conformance]
Kubernetes e2e suite [sig-storage] Ephemeralstorage When pod refers to non-existent ephemeral storage should allow deletion of pod with invalid volume : projected
Kubernetes e2e suite [sig-storage] HostPathType Block Device [Slow] Should fail on mounting block device 'ablkdev' when HostPathType is HostPathCharDev
Kubernetes e2e suite [sig-storage] HostPathType Directory [Slow] Should fail on mounting directory 'adir' when HostPathType is HostPathBlockDev
Kubernetes e2e suite [sig-storage] HostPathType Directory [Slow] Should fail on mounting directory 'adir' when HostPathType is HostPathSocket
Kubernetes e2e suite [sig-storage] HostPathType File [Slow] Should fail on mounting file 'afile' when HostPathType is HostPathCharDev
Kubernetes e2e suite [sig-storage] HostPathType File [Slow] Should fail on mounting file 'afile' when HostPathType is HostPathSocket
Kubernetes e2e suite [sig-storage] HostPathType File [Slow] Should fail on mounting non-existent file 'does-not-exist-file' when HostPathType is HostPathFile
Kubernetes e2e suite [sig-storage] HostPathType Socket [Slow] Should be able to mount socket 'asocket' successfully when HostPathType is HostPathSocket
Kubernetes e2e suite [sig-storage] HostPathType Socket [Slow] Should fail on mounting socket 'asocket' when HostPathType is HostPathDirectory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits should support volume limits [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Inline-volume (xfs)][Slow] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-disk] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Inline-volume (xfs)][Slow] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: azure-file] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with mount options
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] capacity provides storage capacity information
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (default fs)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: ceph][Feature:Volumes][Serial] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ext3)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (immediate binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with snapshot data source [Feature:VolumeSnapshotDataSource]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is force deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] capacity provides storage capacity information
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should support volume limits [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Dynamic PV (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Inline-volume (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Inline-volume (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Inline-volume (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Inline-volume (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Inline-volume (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (filesystem volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv written before kubelet restart is readable after restart.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (block volmode)] volumeMode should fail to use a volume in a pod with mismatched mode [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should unmount if pod is force deleted while kubelet is down [Disruptive][Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the single read-only volume from pods on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath directory is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (default fs)] subPath should fail if subpath file is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (xfs)][Slow] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive][LinuxOnly] Should test that pv used in a pod that is deleted while the kubelet is down cleans up when the kubelet returns.
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (default fs)] subPath should verify container cannot write to subpath readonly volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the single volume from pods on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes should allow exec of files on the volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with any volume data source [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source in parallel [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (default fs)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (default fs)] volume-stress multiple pods should access different volumes repeatedly [Slow] [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ext3)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with different volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ext4)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on the same node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ext4)] volumes should store data
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] should access to two volumes with the same volume mode and retain data across pod recreation on different node
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should verify that all csinodes have volume limits
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] multiVolume [Slow] should concurrently access the volume and its clone from pods on the same node [LinuxOnly][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with mount options
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Dynamic PV (xfs)][Slow] multiVolume [Slow] should concurrently access the volume and restored snapshot from pods on the same node [LinuxOnly][Feature:VolumeSnapshotDataSource][Feature:VolumeSourceXFS]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits should support volume limits [Serial]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Inline-volume (default fs)] subPath should support creating multiple subpath from same volumes [Slow]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using file as subpath [Slow][LinuxOnly]
Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostP