ci-kubernetes-e2e-ubuntu-gce-containerd #1540997119748345856
Recent runs || View in Spyglass
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-node\]\sMount\spropagation\sshould\spropagate\smounts\swithin\sdefined\sscopes$'
test/e2e/node/mount_propagation.go:85 Jun 26 10:07:18.508: failed to execute command in pod slave, container cntr: error dialing backend: dial timeout, backstop: error dialing backend: dial timeout, backstop test/e2e/framework/exec_util.go:105from junit_01.xml
[BeforeEach] [sig-node] Mount propagation test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 26 10:06:35.350: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename mount-propagation �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should propagate mounts within defined scopes test/e2e/node/mount_propagation.go:85 Jun 26 10:06:35.851: INFO: Waiting up to 5m0s for pod "master" in namespace "mount-propagation-1946" to be "running and ready" Jun 26 10:06:35.893: INFO: Pod "master": Phase="Pending", Reason="", readiness=false. Elapsed: 42.432405ms Jun 26 10:06:35.893: INFO: The phase of Pod master is Pending, waiting for it to be Running (with Ready = true) Jun 26 10:06:37.933: INFO: Pod "master": Phase="Pending", Reason="", readiness=false. Elapsed: 2.082250461s Jun 26 10:06:37.933: INFO: The phase of Pod master is Pending, waiting for it to be Running (with Ready = true) Jun 26 10:06:39.930: INFO: Pod "master": Phase="Running", Reason="", readiness=true. Elapsed: 4.079599526s Jun 26 10:06:39.930: INFO: The phase of Pod master is Running (Ready = true) Jun 26 10:06:39.930: INFO: Pod "master" satisfied condition "running and ready" Jun 26 10:06:40.003: INFO: Waiting up to 5m0s for pod "slave" in namespace "mount-propagation-1946" to be "running and ready" Jun 26 10:06:40.038: INFO: Pod "slave": Phase="Pending", Reason="", readiness=false. Elapsed: 35.507188ms Jun 26 10:06:40.038: INFO: The phase of Pod slave is Pending, waiting for it to be Running (with Ready = true) Jun 26 10:06:42.073: INFO: Pod "slave": Phase="Running", Reason="", readiness=true. Elapsed: 2.070550692s Jun 26 10:06:42.073: INFO: The phase of Pod slave is Running (Ready = true) Jun 26 10:06:42.073: INFO: Pod "slave" satisfied condition "running and ready" Jun 26 10:06:42.146: INFO: Waiting up to 5m0s for pod "private" in namespace "mount-propagation-1946" to be "running and ready" Jun 26 10:06:42.183: INFO: Pod "private": Phase="Pending", Reason="", readiness=false. Elapsed: 37.294961ms Jun 26 10:06:42.183: INFO: The phase of Pod private is Pending, waiting for it to be Running (with Ready = true) Jun 26 10:06:44.219: INFO: Pod "private": Phase="Running", Reason="", readiness=true. Elapsed: 2.073561148s Jun 26 10:06:44.219: INFO: The phase of Pod private is Running (Ready = true) Jun 26 10:06:44.219: INFO: Pod "private" satisfied condition "running and ready" Jun 26 10:06:44.299: INFO: Waiting up to 5m0s for pod "default" in namespace "mount-propagation-1946" to be "running and ready" Jun 26 10:06:44.337: INFO: Pod "default": Phase="Pending", Reason="", readiness=false. Elapsed: 37.532339ms Jun 26 10:06:44.337: INFO: The phase of Pod default is Pending, waiting for it to be Running (with Ready = true) Jun 26 10:06:46.376: INFO: Pod "default": Phase="Running", Reason="", readiness=true. Elapsed: 2.076791291s Jun 26 10:06:46.376: INFO: The phase of Pod default is Running (Ready = true) Jun 26 10:06:46.376: INFO: Pod "default" satisfied condition "running and ready" Jun 26 10:06:46.454: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /mnt/test/master] Namespace:mount-propagation-1946 PodName:master ContainerName:cntr Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:46.454: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:46.455: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:46.455: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/mount-propagation-1946/pods/master/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fmnt%2Ftest%2Fmaster&container=cntr&container=cntr&stderr=true&stdout=true) Jun 26 10:06:46.870: INFO: Exec stderr: "" Jun 26 10:06:46.923: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /mnt/test/slave] Namespace:mount-propagation-1946 PodName:master ContainerName:cntr Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:46.923: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:46.924: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:46.924: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/mount-propagation-1946/pods/master/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fmnt%2Ftest%2Fslave&container=cntr&container=cntr&stderr=true&stdout=true) Jun 26 10:06:47.308: INFO: Exec stderr: "" Jun 26 10:06:47.343: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /mnt/test/private] Namespace:mount-propagation-1946 PodName:master ContainerName:cntr Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:47.343: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:47.344: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:47.344: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/mount-propagation-1946/pods/master/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fmnt%2Ftest%2Fprivate&container=cntr&container=cntr&stderr=true&stdout=true) Jun 26 10:06:47.632: INFO: Exec stderr: "" Jun 26 10:06:47.668: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /mnt/test/default] Namespace:mount-propagation-1946 PodName:master ContainerName:cntr Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:47.668: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:47.669: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:47.669: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/mount-propagation-1946/pods/master/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fmnt%2Ftest%2Fdefault&container=cntr&container=cntr&stderr=true&stdout=true) Jun 26 10:06:48.028: INFO: Exec stderr: "" Jun 26 10:06:48.064: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /mnt/test/master] Namespace:mount-propagation-1946 PodName:slave ContainerName:cntr Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:48.064: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:48.065: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:48.066: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/mount-propagation-1946/pods/slave/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fmnt%2Ftest%2Fmaster&container=cntr&container=cntr&stderr=true&stdout=true) Jun 26 10:06:48.351: INFO: Exec stderr: "" Jun 26 10:06:48.391: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /mnt/test/slave] Namespace:mount-propagation-1946 PodName:slave ContainerName:cntr Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:48.391: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:48.392: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:48.392: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/mount-propagation-1946/pods/slave/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fmnt%2Ftest%2Fslave&container=cntr&container=cntr&stderr=true&stdout=true) Jun 26 10:07:18.508: INFO: Exec stderr: "" Jun 26 10:07:18.508: INFO: Unexpected error: failed to execute command in pod slave, container cntr: error dialing backend: dial timeout, backstop: <*errors.StatusError | 0xc000af6320>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } Jun 26 10:07:18.508: FAIL: failed to execute command in pod slave, container cntr: error dialing backend: dial timeout, backstop: error dialing backend: dial timeout, backstop Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).ExecCommandInContainer(0xc0033d2ad0?, {0xc001cb1333, 0x5}, {0xc0037df3d0, 0x4}, {0xc00370e5a0?, 0xc0036da600?, 0x7a92690?}) test/e2e/framework/exec_util.go:105 +0x1af k8s.io/kubernetes/test/e2e/framework.(*Framework).execCommandInPod(0x71fc7a1?, {0xc001cb1333, 0x5}, {0xc00370e5a0, 0x3, 0x3}) test/e2e/framework/exec_util.go:120 +0x225 k8s.io/kubernetes/test/e2e/framework.(*Framework).ExecShellInPod(...) test/e2e/framework/exec_util.go:132 k8s.io/kubernetes/test/e2e/node.glob..func7.1() test/e2e/node/mount_propagation.go:131 +0x5f9 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000bc6820, 0x746f348) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f Jun 26 10:07:18.619: INFO: Waiting up to 5m0s for pod "hostexec-bootstrap-e2e-minion-group-zvd6-mmznv" in namespace "mount-propagation-1946" to be "running" Jun 26 10:07:18.681: INFO: Pod "hostexec-bootstrap-e2e-minion-group-zvd6-mmznv": Phase="Pending", Reason="", readiness=false. Elapsed: 61.962364ms Jun 26 10:07:20.730: INFO: Pod "hostexec-bootstrap-e2e-minion-group-zvd6-mmznv": Phase="Running", Reason="", readiness=true. Elapsed: 2.110658857s Jun 26 10:07:20.730: INFO: Pod "hostexec-bootstrap-e2e-minion-group-zvd6-mmznv" satisfied condition "running" Jun 26 10:07:20.730: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -rf "/var/lib/kubelet/mount-propagation-1946"] Namespace:mount-propagation-1946 PodName:hostexec-bootstrap-e2e-minion-group-zvd6-mmznv ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:07:20.730: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:07:20.731: INFO: ExecWithOptions: Clientset creation Jun 26 10:07:20.731: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/mount-propagation-1946/pods/hostexec-bootstrap-e2e-minion-group-zvd6-mmznv/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-rf+%22%2Fvar%2Flib%2Fkubelet%2Fmount-propagation-1946%22&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) �[1mSTEP�[0m: Deleting pod hostexec-bootstrap-e2e-minion-group-zvd6-mmznv in namespace mount-propagation-1946 [AfterEach] [sig-node] Mount propagation test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Collecting events from namespace "mount-propagation-1946". �[1mSTEP�[0m: Found 16 events. Jun 26 10:07:21.359: INFO: At 2022-06-26 10:06:36 +0000 UTC - event for master: {kubelet bootstrap-e2e-minion-group-zvd6} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 26 10:07:21.359: INFO: At 2022-06-26 10:06:36 +0000 UTC - event for master: {kubelet bootstrap-e2e-minion-group-zvd6} Started: Started container cntr Jun 26 10:07:21.360: INFO: At 2022-06-26 10:06:36 +0000 UTC - event for master: {kubelet bootstrap-e2e-minion-group-zvd6} Created: Created container cntr Jun 26 10:07:21.360: INFO: At 2022-06-26 10:06:40 +0000 UTC - event for slave: {kubelet bootstrap-e2e-minion-group-zvd6} Created: Created container cntr Jun 26 10:07:21.360: INFO: At 2022-06-26 10:06:40 +0000 UTC - event for slave: {kubelet bootstrap-e2e-minion-group-zvd6} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 26 10:07:21.360: INFO: At 2022-06-26 10:06:40 +0000 UTC - event for slave: {kubelet bootstrap-e2e-minion-group-zvd6} Started: Started container cntr Jun 26 10:07:21.360: INFO: At 2022-06-26 10:06:42 +0000 UTC - event for private: {kubelet bootstrap-e2e-minion-group-zvd6} Started: Started container cntr Jun 26 10:07:21.360: INFO: At 2022-06-26 10:06:42 +0000 UTC - event for private: {kubelet bootstrap-e2e-minion-group-zvd6} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 26 10:07:21.360: INFO: At 2022-06-26 10:06:42 +0000 UTC - event for private: {kubelet bootstrap-e2e-minion-group-zvd6} Created: Created container cntr Jun 26 10:07:21.360: INFO: At 2022-06-26 10:06:44 +0000 UTC - event for default: {kubelet bootstrap-e2e-minion-group-zvd6} Created: Created container cntr Jun 26 10:07:21.360: INFO: At 2022-06-26 10:06:44 +0000 UTC - event for default: {kubelet bootstrap-e2e-minion-group-zvd6} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 26 10:07:21.360: INFO: At 2022-06-26 10:06:45 +0000 UTC - event for default: {kubelet bootstrap-e2e-minion-group-zvd6} Started: Started container cntr Jun 26 10:07:21.360: INFO: At 2022-06-26 10:07:18 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-zvd6-mmznv: {default-scheduler } Scheduled: Successfully assigned mount-propagation-1946/hostexec-bootstrap-e2e-minion-group-zvd6-mmznv to bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:21.360: INFO: At 2022-06-26 10:07:19 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-zvd6-mmznv: {kubelet bootstrap-e2e-minion-group-zvd6} Started: Started container agnhost-container Jun 26 10:07:21.360: INFO: At 2022-06-26 10:07:19 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-zvd6-mmznv: {kubelet bootstrap-e2e-minion-group-zvd6} Created: Created container agnhost-container Jun 26 10:07:21.360: INFO: At 2022-06-26 10:07:19 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-zvd6-mmznv: {kubelet bootstrap-e2e-minion-group-zvd6} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:07:21.434: INFO: POD NODE PHASE GRACE CONDITIONS Jun 26 10:07:21.434: INFO: default bootstrap-e2e-minion-group-zvd6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:44 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:45 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:45 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:44 +0000 UTC }] Jun 26 10:07:21.434: INFO: master bootstrap-e2e-minion-group-zvd6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:35 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:37 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:37 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:35 +0000 UTC }] Jun 26 10:07:21.434: INFO: private bootstrap-e2e-minion-group-zvd6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:42 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:43 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:43 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:42 +0000 UTC }] Jun 26 10:07:21.434: INFO: slave bootstrap-e2e-minion-group-zvd6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:39 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:41 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:41 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:39 +0000 UTC }] Jun 26 10:07:21.434: INFO: Jun 26 10:07:21.847: INFO: Logging node info for node bootstrap-e2e-master Jun 26 10:07:21.929: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 96f3154f-aacc-400a-ad66-d67f41c6b36b 9275 0 2022-06-26 10:01:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860045824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597901824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.168.138.173,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:948953d461317864b1fe4464d95c432a,SystemUUID:948953d4-6131-7864-b1fe-4464d95c432a,BootID:e5607f80-4a27-4601-af47-005a2514594d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:127703507,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:117521209,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:51075896,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:9870ed22905d03e3fa5cd2d57118784999fb581c49310f6cac0c3795bcdd7ee7 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.32],SizeBytes:17930113,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:21.929: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 26 10:07:21.988: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 26 10:07:22.069: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.069: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:22.069: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.069: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:22.069: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.069: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 26 10:07:22.069: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.069: INFO: Container kube-apiserver ready: true, restart count 0 Jun 26 10:07:22.069: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-26 10:00:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.069: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 26 10:07:22.069: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-26 10:00:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.069: INFO: Container l7-lb-controller ready: true, restart count 2 Jun 26 10:07:22.069: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.069: INFO: Container kube-controller-manager ready: true, restart count 1 Jun 26 10:07:22.069: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.069: INFO: Container kube-scheduler ready: true, restart count 0 Jun 26 10:07:22.069: INFO: metadata-proxy-v0.1-79zmr started at 2022-06-26 10:01:13 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:22.069: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:22.069: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:22.376: INFO: Latency metrics for node bootstrap-e2e-master Jun 26 10:07:22.376: INFO: Logging node info for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:22.435: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-kv80 8fe21414-4e64-490c-92b5-167dc1e64d0a 9403 0 2022-06-26 10:01:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-kv80 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-kv80 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:06:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:34 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-kv80,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.113.50,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b6c246299f5ddd34e63819759303fbd4,SystemUUID:b6c24629-9f5d-dd34-e638-19759303fbd4,BootID:b4e429f5-615d-4b99-b5eb-195153abb687,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:22.435: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:22.497: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:22.656: INFO: l7-default-backend-5f6f9745f9-95c2d started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.656: INFO: Container default-http-backend ready: true, restart count 0 Jun 26 10:07:22.656: INFO: konnectivity-agent-gh7lr started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.656: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:22.656: INFO: deployment-6c468f5898-sqsr7 started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.656: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:22.656: INFO: volume-snapshot-controller-0 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.656: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 26 10:07:22.656: INFO: execpod-affinityt97jd started at 2022-06-26 10:06:40 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.656: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:22.656: INFO: affinity-nodeport-timeout-2259x started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.656: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:22.656: INFO: kube-proxy-bootstrap-e2e-minion-group-kv80 started at 2022-06-26 10:01:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.656: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:22.656: INFO: npd-v0.8.9-vsk67 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.656: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:22.656: INFO: pfpod started at 2022-06-26 10:06:51 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:22.656: INFO: Container portforwardtester ready: false, restart count 0 Jun 26 10:07:22.656: INFO: Container readiness ready: false, restart count 0 Jun 26 10:07:22.656: INFO: metadata-proxy-v0.1-glv9b started at 2022-06-26 10:01:12 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:22.656: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:22.656: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:22.656: INFO: coredns-85bc9d67b-2pcch started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.656: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:22.656: INFO: deployment-5cd6f9c8c9-pm2kh started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.656: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:23.062: INFO: Latency metrics for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:23.062: INFO: Logging node info for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:23.116: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l6r5 bcf9cd6e-4842-45b7-9f21-7de490b4df8c 9626 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l6r5 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l6r5 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6165":"bootstrap-e2e-minion-group-l6r5","csi-mock-csi-mock-volumes-9260":"bootstrap-e2e-minion-group-l6r5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-06-26 10:01:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:07:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} }]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-l6r5,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-06-26 10:06:59 +0000 UTC,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoExecute,TimeAdded:2022-06-26 10:07:04 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:35.227.167.115,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5bb667ad496693fbfa6f2dcbfb63cab,SystemUUID:f5bb667a-d496-693f-bfa6-f2dcbfb63cab,BootID:730f0552-4b2a-4a66-b12d-5824a7e7a976,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858,DevicePath:,},},Config:nil,},} Jun 26 10:07:23.117: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:23.170: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:23.276: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l6r5: error trying to reach service: dial tcp 10.138.0.5:10250: connect: connection refused Jun 26 10:07:23.276: INFO: Logging node info for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:23.333: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-w1f4 aa1194c1-9599-41dd-8e29-c249fef7248e 9523 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-w1f4 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-w1f4 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:04:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-w1f4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.185.251.58,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38c15cfcea7d87fcfdfb495c46c9f2bd,SystemUUID:38c15cfc-ea7d-87fc-fdfb-495c46c9f2bd,BootID:f547655d-3f0b-4b8f-9e52-ac7560e71bb7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:23.333: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:23.413: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:23.547: INFO: hairpin started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:23.547: INFO: rand-non-local-rcw7v started at 2022-06-26 10:06:45 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container c ready: false, restart count 0 Jun 26 10:07:23.547: INFO: service-headless-rfn2p started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:23.547: INFO: affinity-nodeport-timeout-pf8ht started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:23.547: INFO: verify-service-up-host-exec-pod started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:23.547: INFO: kube-proxy-bootstrap-e2e-minion-group-w1f4 started at 2022-06-26 10:01:19 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:23.547: INFO: konnectivity-agent-8w8st started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:23.547: INFO: pod-projected-secrets-d0859f57-a6b7-4b81-be26-970fd1a684b4 started at 2022-06-26 10:05:58 +0000 UTC (0+3 container statuses recorded) Jun 26 10:07:23.547: INFO: Container creates-volume-test ready: true, restart count 0 Jun 26 10:07:23.547: INFO: Container dels-volume-test ready: true, restart count 0 Jun 26 10:07:23.547: INFO: Container upds-volume-test ready: true, restart count 0 Jun 26 10:07:23.547: INFO: deployment-5cd6f9c8c9-2s82l started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:23.547: INFO: kube-dns-autoscaler-5477bd659c-hwxn2 started at 2022-06-26 10:06:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container autoscaler ready: true, restart count 0 Jun 26 10:07:23.547: INFO: hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc started at 2022-06-26 10:06:27 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:23.547: INFO: service-headless-toggled-flcct started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:23.547: INFO: npd-v0.8.9-hzvbm started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:23.547: INFO: liveness-1ffb8679-e880-42c5-9594-e7ce6b90aafe started at 2022-06-26 10:04:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:23.547: INFO: rand-non-local-gxjbx started at 2022-06-26 10:07:01 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container c ready: false, restart count 0 Jun 26 10:07:23.547: INFO: test-grpc-0024d73f-6f4d-4e93-a689-31d246e3fd09 started at 2022-06-26 10:05:32 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container etcd ready: true, restart count 0 Jun 26 10:07:23.547: INFO: metadata-proxy-v0.1-lj6mb started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:23.547: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:23.547: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:23.547: INFO: rand-non-local-9thk7 started at 2022-06-26 10:06:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:23.547: INFO: Container c ready: false, restart count 0 Jun 26 10:07:23.841: INFO: Latency metrics for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:23.841: INFO: Logging node info for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:23.888: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-zvd6 465e1e7d-9f60-42b7-acea-e8cd1dca80e2 9527 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-zvd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-zvd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2385":"bootstrap-e2e-minion-group-zvd6","csi-hostpath-provisioning-6151":"bootstrap-e2e-minion-group-zvd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-26 10:06:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-zvd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.91.218,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aa6080e0da2673fad5141cc4863e32c,SystemUUID:4aa6080e-0da2-673f-ad51-41cc4863e32c,BootID:628a7f46-4bbe-40bc-aa89-4f2b41dd6222,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62,DevicePath:,},},Config:nil,},} Jun 26 10:07:23.889: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:23.937: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:24.013: INFO: inline-volume-tester-nkqft started at 2022-06-26 10:05:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container csi-volume-tester ready: true, restart count 0 Jun 26 10:07:24.013: INFO: service-headless-toggled-27ccn started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:24.013: INFO: service-headless-lrtx9 started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:24.013: INFO: master started at 2022-06-26 10:06:35 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:24.013: INFO: adopt-release-brsdt started at 2022-06-26 10:06:21 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container c ready: false, restart count 0 Jun 26 10:07:24.013: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:05:43 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:24.013: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:24.013: INFO: slave started at 2022-06-26 10:06:39 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:24.013: INFO: default started at 2022-06-26 10:06:44 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:24.013: INFO: affinity-nodeport-timeout-4b548 started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:24.013: INFO: metadata-proxy-v0.1-hrd5b started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:24.013: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:24.013: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:06:28 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:24.013: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:24.013: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:24.013: INFO: verify-service-up-exec-pod-85m6b started at 2022-06-26 10:06:26 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:24.013: INFO: coredns-85bc9d67b-6grvl started at 2022-06-26 10:05:59 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:24.013: INFO: private started at 2022-06-26 10:06:42 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:24.013: INFO: kube-proxy-bootstrap-e2e-minion-group-zvd6 started at 2022-06-26 10:01:20 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:24.013: INFO: npd-v0.8.9-w26wg started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:24.013: INFO: konnectivity-agent-thvrv started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:24.013: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:24.307: INFO: Latency metrics for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:24.307: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready Jun 26 10:07:24.374: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:26.512: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:28.519: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:30.500: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:32.496: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:34.508: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:36.496: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:38.505: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:40.499: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:42.511: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:44.534: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:46.522: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:48.505: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:50.512: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:52.501: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:54.492: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:56.537: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:58.539: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:08:00.513: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:08:02.515: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:04.483: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:06.481: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:08.482: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:10.480: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:12.481: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:14.499: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure �[1mSTEP�[0m: Destroying namespace "mount-propagation-1946" for this suite.
Find slave, mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\smock\svolume\sCSI\sattach\stest\susing\smock\sdriver\sshould\snot\srequire\sVolumeAttach\sfor\sdrivers\swithout\sattachment$'
test/e2e/storage/csi_mock_volume.go:360 Jun 26 10:11:22.392: Failed to start pod: timed out while waiting for pod csi-mock-volumes-9260/pvc-volume-tester-qf9qg to be running: timed out while waiting for pod csi-mock-volumes-9260/pvc-volume-tester-qf9qg to be running test/e2e/storage/csi_mock_volume.go:374from junit_23.xml
[BeforeEach] [sig-storage] CSI mock volume test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 26 10:06:12.539: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename csi-mock-volumes �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should not require VolumeAttach for drivers without attachment test/e2e/storage/csi_mock_volume.go:360 �[1mSTEP�[0m: Building a driver namespace object, basename csi-mock-volumes-9260 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi mock driver Jun 26 10:06:13.265: INFO: creating *v1.ServiceAccount: csi-mock-volumes-9260-4323/csi-attacher Jun 26 10:06:13.317: INFO: creating *v1.ClusterRole: external-attacher-runner-csi-mock-volumes-9260 Jun 26 10:06:13.317: INFO: Define cluster role external-attacher-runner-csi-mock-volumes-9260 Jun 26 10:06:13.361: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-csi-mock-volumes-9260 Jun 26 10:06:13.407: INFO: creating *v1.Role: csi-mock-volumes-9260-4323/external-attacher-cfg-csi-mock-volumes-9260 Jun 26 10:06:13.447: INFO: creating *v1.RoleBinding: csi-mock-volumes-9260-4323/csi-attacher-role-cfg Jun 26 10:06:13.486: INFO: creating *v1.ServiceAccount: csi-mock-volumes-9260-4323/csi-provisioner Jun 26 10:06:13.525: INFO: creating *v1.ClusterRole: external-provisioner-runner-csi-mock-volumes-9260 Jun 26 10:06:13.525: INFO: Define cluster role external-provisioner-runner-csi-mock-volumes-9260 Jun 26 10:06:13.571: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-csi-mock-volumes-9260 Jun 26 10:06:13.616: INFO: creating *v1.Role: csi-mock-volumes-9260-4323/external-provisioner-cfg-csi-mock-volumes-9260 Jun 26 10:06:13.656: INFO: creating *v1.RoleBinding: csi-mock-volumes-9260-4323/csi-provisioner-role-cfg Jun 26 10:06:13.693: INFO: creating *v1.ServiceAccount: csi-mock-volumes-9260-4323/csi-resizer Jun 26 10:06:13.731: INFO: creating *v1.ClusterRole: external-resizer-runner-csi-mock-volumes-9260 Jun 26 10:06:13.731: INFO: Define cluster role external-resizer-runner-csi-mock-volumes-9260 Jun 26 10:06:13.770: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-csi-mock-volumes-9260 Jun 26 10:06:13.807: INFO: creating *v1.Role: csi-mock-volumes-9260-4323/external-resizer-cfg-csi-mock-volumes-9260 Jun 26 10:06:13.854: INFO: creating *v1.RoleBinding: csi-mock-volumes-9260-4323/csi-resizer-role-cfg Jun 26 10:06:13.892: INFO: creating *v1.ServiceAccount: csi-mock-volumes-9260-4323/csi-snapshotter Jun 26 10:06:13.930: INFO: creating *v1.ClusterRole: external-snapshotter-runner-csi-mock-volumes-9260 Jun 26 10:06:13.930: INFO: Define cluster role external-snapshotter-runner-csi-mock-volumes-9260 Jun 26 10:06:13.982: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-csi-mock-volumes-9260 Jun 26 10:06:14.074: INFO: creating *v1.Role: csi-mock-volumes-9260-4323/external-snapshotter-leaderelection-csi-mock-volumes-9260 Jun 26 10:06:14.124: INFO: creating *v1.RoleBinding: csi-mock-volumes-9260-4323/external-snapshotter-leaderelection Jun 26 10:06:14.161: INFO: creating *v1.ServiceAccount: csi-mock-volumes-9260-4323/csi-mock Jun 26 10:06:14.217: INFO: creating *v1.ClusterRoleBinding: csi-controller-attacher-role-csi-mock-volumes-9260 Jun 26 10:06:14.253: INFO: creating *v1.ClusterRoleBinding: csi-controller-provisioner-role-csi-mock-volumes-9260 Jun 26 10:06:14.291: INFO: creating *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-csi-mock-volumes-9260 Jun 26 10:06:14.329: INFO: creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-csi-mock-volumes-9260 Jun 26 10:06:14.367: INFO: creating *v1.ClusterRoleBinding: csi-controller-resizer-role-csi-mock-volumes-9260 Jun 26 10:06:14.405: INFO: creating *v1.ClusterRoleBinding: csi-controller-snapshotter-role-csi-mock-volumes-9260 Jun 26 10:06:14.441: INFO: creating *v1.StorageClass: csi-mock-sc-csi-mock-volumes-9260 Jun 26 10:06:14.487: INFO: creating *v1.StatefulSet: csi-mock-volumes-9260-4323/csi-mockplugin Jun 26 10:06:14.528: INFO: creating *v1.CSIDriver: csi-mock-csi-mock-volumes-9260 Jun 26 10:06:14.581: INFO: waiting up to 4m0s for CSIDriver "csi-mock-csi-mock-volumes-9260" Jun 26 10:06:14.623: INFO: waiting for CSIDriver csi-mock-csi-mock-volumes-9260 to register on node bootstrap-e2e-minion-group-l6r5 �[1mSTEP�[0m: Creating pod Jun 26 10:06:19.953: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Jun 26 10:06:20.059: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-fgfwp] to have phase Bound Jun 26 10:06:20.130: INFO: PersistentVolumeClaim pvc-fgfwp found but phase is Pending instead of Bound. Jun 26 10:06:22.170: INFO: PersistentVolumeClaim pvc-fgfwp found and phase=Bound (2.111293883s) Jun 26 10:06:22.279: INFO: Waiting up to 5m0s for pod "pvc-volume-tester-qf9qg" in namespace "csi-mock-volumes-9260" to be "running" Jun 26 10:06:22.314: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 34.821076ms Jun 26 10:06:24.351: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071238234s Jun 26 10:06:26.365: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.085362445s Jun 26 10:06:28.357: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 6.077749699s Jun 26 10:06:30.353: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 8.07409258s Jun 26 10:06:32.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 10.07315595s Jun 26 10:06:34.416: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 12.136624286s Jun 26 10:06:36.351: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 14.071406108s Jun 26 10:06:38.355: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 16.075469904s Jun 26 10:06:40.358: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 18.078355145s Jun 26 10:06:42.350: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 20.070782203s Jun 26 10:06:44.353: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 22.073807247s Jun 26 10:06:46.358: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 24.0787174s Jun 26 10:06:48.351: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 26.071946168s Jun 26 10:06:50.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 28.072338548s Jun 26 10:06:52.359: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 30.079792315s Jun 26 10:06:54.364: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 32.084566579s Jun 26 10:06:56.382: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 34.103150446s Jun 26 10:06:58.364: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 36.084737414s WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get "https://10.138.0.5:10250/containerLogs/csi-mock-volumes-9260-4323/csi-mockplugin-0/csi-provisioner?follow=true": dial tcp 10.138.0.5:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get "https://10.138.0.5:10250/containerLogs/csi-mock-volumes-9260-4323/csi-mockplugin-0/driver-registrar?follow=true": dial tcp 10.138.0.5:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get "https://10.138.0.5:10250/containerLogs/csi-mock-volumes-9260-4323/csi-mockplugin-0/mock?follow=true": dial tcp 10.138.0.5:10250: connect: connection refused Jun 26 10:07:00.409: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 38.129243824s Jun 26 10:07:02.373: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 40.093683639s Jun 26 10:07:04.370: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 42.090951938s Jun 26 10:07:06.372: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 44.092328027s Jun 26 10:07:08.373: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 46.093467153s Jun 26 10:07:10.380: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 48.100924136s Jun 26 10:07:12.373: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 50.093713478s Jun 26 10:07:14.367: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 52.088112556s Jun 26 10:07:16.357: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 54.07787722s Jun 26 10:07:18.405: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 56.125824876s Jun 26 10:07:20.445: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 58.16521597s Jun 26 10:07:22.377: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.097667744s Jun 26 10:07:24.429: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.149532186s Jun 26 10:07:26.387: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.10757816s Jun 26 10:07:28.370: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.090943666s Jun 26 10:07:30.362: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.082990611s Jun 26 10:07:32.364: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.084457089s Jun 26 10:07:34.378: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.098553013s Jun 26 10:07:36.364: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.084200221s Jun 26 10:07:38.388: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.108556469s Jun 26 10:07:40.354: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.074945106s Jun 26 10:07:42.364: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.084934298s Jun 26 10:07:44.372: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.092852395s Jun 26 10:07:46.379: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.099296767s Jun 26 10:07:48.364: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.084342985s Jun 26 10:07:50.370: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.090916493s Jun 26 10:07:52.371: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.09160098s Jun 26 10:07:54.363: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.083549188s Jun 26 10:07:56.392: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.113118746s Jun 26 10:07:58.457: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.177215389s Jun 26 10:08:00.364: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.084424696s Jun 26 10:08:02.358: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.079131935s Jun 26 10:08:04.353: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.073729166s Jun 26 10:08:06.357: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.077974279s Jun 26 10:08:08.353: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.0741163s Jun 26 10:08:10.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.072264106s Jun 26 10:08:12.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.072186193s Jun 26 10:08:14.367: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.087663048s Jun 26 10:08:16.350: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.070177295s Jun 26 10:08:18.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.07295403s Jun 26 10:08:20.354: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.074244304s Jun 26 10:08:22.390: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.111088137s Jun 26 10:08:24.379: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.099908338s Jun 26 10:08:26.396: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.116338496s Jun 26 10:08:28.380: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.100741928s Jun 26 10:08:30.490: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.210349332s Jun 26 10:08:32.405: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.125834331s Jun 26 10:08:34.427: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.148132631s Jun 26 10:08:36.365: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.086081638s Jun 26 10:08:38.370: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.090991217s Jun 26 10:08:40.379: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.100010587s Jun 26 10:08:42.397: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.117702765s Jun 26 10:08:44.375: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.095358532s Jun 26 10:08:46.384: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.104489656s Jun 26 10:08:48.377: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.097566693s Jun 26 10:08:50.386: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.106986092s Jun 26 10:08:52.430: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.150780956s Jun 26 10:08:54.398: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.119130547s Jun 26 10:08:56.385: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.105721845s Jun 26 10:08:58.368: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.088164036s Jun 26 10:09:00.355: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.075455523s Jun 26 10:09:02.368: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.08826353s Jun 26 10:09:04.403: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.123429909s Jun 26 10:09:06.358: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.078936372s Jun 26 10:09:08.350: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.070832562s Jun 26 10:09:10.349: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.070038911s Jun 26 10:09:12.401: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.121618288s Jun 26 10:09:14.418: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.138377045s Jun 26 10:09:16.369: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.090078542s Jun 26 10:09:18.369: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.089676797s Jun 26 10:09:20.375: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.095563872s Jun 26 10:09:22.452: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.172783566s Jun 26 10:09:24.419: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.139483382s Jun 26 10:09:26.396: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.117052814s Jun 26 10:09:28.431: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.151170258s Jun 26 10:09:30.458: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.178318568s Jun 26 10:09:32.397: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.117651219s Jun 26 10:09:34.501: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.221821552s Jun 26 10:09:36.411: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.132130593s Jun 26 10:09:38.361: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.08144432s Jun 26 10:09:40.359: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.079411834s Jun 26 10:09:42.389: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.109333175s Jun 26 10:09:44.363: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.083703898s Jun 26 10:09:46.364: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.084373746s Jun 26 10:09:48.357: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.077414797s Jun 26 10:09:50.350: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.070464313s Jun 26 10:09:52.367: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.087778477s Jun 26 10:09:54.350: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.070920078s Jun 26 10:09:56.350: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.070881919s Jun 26 10:09:58.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.072835779s Jun 26 10:10:00.387: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.1077153s Jun 26 10:10:02.377: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.097178615s Jun 26 10:10:04.369: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.089231278s Jun 26 10:10:06.387: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.108139251s Jun 26 10:10:08.411: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.131773879s Jun 26 10:10:10.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.072420745s Jun 26 10:10:12.454: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.174287027s Jun 26 10:10:14.381: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.102024558s Jun 26 10:10:16.368: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.089026577s Jun 26 10:10:18.351: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.071923056s Jun 26 10:10:20.351: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.07146251s Jun 26 10:10:22.507: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.22785716s Jun 26 10:10:24.358: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.079018042s Jun 26 10:10:26.426: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.14662756s Jun 26 10:10:28.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.073153338s Jun 26 10:10:30.349: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.070045493s Jun 26 10:10:32.388: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.108378046s Jun 26 10:10:34.487: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.20778707s Jun 26 10:10:36.374: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.095012381s Jun 26 10:10:38.367: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.088132382s Jun 26 10:10:40.350: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.070196114s Jun 26 10:10:42.371: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.091428314s Jun 26 10:10:44.357: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.07729776s Jun 26 10:10:46.426: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.146515616s Jun 26 10:10:48.355: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.076093519s Jun 26 10:10:50.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.072301373s Jun 26 10:10:52.371: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.091556822s Jun 26 10:10:54.369: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.089248163s Jun 26 10:10:56.375: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.095635453s Jun 26 10:10:58.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.072257012s Jun 26 10:11:00.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.072613467s Jun 26 10:11:02.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.072475008s Jun 26 10:11:04.393: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.113887844s Jun 26 10:11:06.425: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.145590894s Jun 26 10:11:08.355: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.075696297s Jun 26 10:11:10.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.073136315s Jun 26 10:11:12.480: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.20080043s Jun 26 10:11:14.378: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.098359465s Jun 26 10:11:16.358: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.078515792s Jun 26 10:11:18.365: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.085590551s Jun 26 10:11:20.353: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.073448069s Jun 26 10:11:22.352: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.07222384s Jun 26 10:11:22.391: INFO: Pod "pvc-volume-tester-qf9qg": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.111182391s Jun 26 10:11:22.392: INFO: Unexpected error: Failed to start pod: timed out while waiting for pod csi-mock-volumes-9260/pvc-volume-tester-qf9qg to be running: <*pod.timeoutError | 0xc000b1ad80>: { msg: "timed out while waiting for pod csi-mock-volumes-9260/pvc-volume-tester-qf9qg to be running", observedObjects: [ { TypeMeta: {Kind: "", APIVersion: ""}, ObjectMeta: { Name: "pvc-volume-tester-qf9qg", GenerateName: "pvc-volume-tester-", Namespace: "csi-mock-volumes-9260", SelfLink: "", UID: "50db1f22-4098-4afb-8ff9-39450800eaba", ResourceVersion: "10084", Generation: 0, CreationTimestamp: { Time: { wall: 0, ext: 63791834782, loc: { name: "Local", zone: [ {name: "UTC", offset: 0, isDST: false}, ], tx: [ { when: -576460752303423488, index: 0, isstd: false, isutc: false, }, ], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: "UTC", offset: 0, isDST: false}, }, }, }, DeletionTimestamp: nil, DeletionGracePeriodSeconds: nil, Labels: nil, Annotations: nil, OwnerReferences: nil, Finalizers: nil, ManagedFields: [ { Manager: "e2e.test", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63791834782, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:affinity\":{\".\":{},\"f:nodeAffinity\":{\".\":{},\"f:requiredDuringSchedulingIgnoredDuringExecution\":{}}},\"f:containers\":{\"k:{\\\"name\\\":\\\"volume-tester\\\"}\":{\".\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{},\"f:volumeMounts\":{\".\":{},\"k:{\\\"mountPath\\\":\\\"/mnt/test\\\"}\":{\".\":{},\"f:mountPath\":{},\"f:name\":{}}}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{},\"f:volumes\":{\".\":{},\"k:{\\\"name\\\":\\\"my-volume\\\"}\":{\".\":{},\"f:name\":{},\"f:persistentVolumeClaim\":{\".\":{},\"f:claimName\":{}}}}}}", }, Subresource: "", }, { Manager: "kubelet", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63791834898, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}", }, Subresource: "status", }, ], }, Spec: { Volumes: [ { Name: "my-volume", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, Secret: nil, NFS: nil, ISCSI: nil, Glusterfs: nil, PersistentVolumeClaim: { ClaimName: "pvc-fgfwp", ReadOnly: false, }, RBD: nil, FlexVolume: nil, Cinder: nil, CephFS: nil, Flocker: nil, DownwardAPI: nil, FC: nil, AzureFile: nil, ConfigMap: nil, VsphereVolume: nil, Quobyte: nil, AzureDisk: nil, PhotonPersistentDisk: nil, Projected: nil, PortworxVolume: nil, ScaleIO: nil, StorageOS: nil, CSI: nil, Ephemeral: nil, }, }, { Name: "kube-api-access-sn87r", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, Secret: nil, NFS: nil, ISCSI: nil, Glusterfs: nil, PersistentVolumeClaim: nil, RBD: nil, FlexVolume: nil, Cinder: nil, CephFS: nil, Flocker: nil, DownwardAPI: nil, FC: nil, AzureFile: nil, ConfigMap: nil, VsphereVolume: nil, Quobyte: nil, AzureDisk: nil, PhotonPersistentDisk: nil, Projected: { Sources: [ { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, ], DefaultMode: 420, }, PortworxVolume: nil, ScaleIO: nil, StorageOS: nil, CSI: nil, Ephemeral: nil, }, }, ], InitContainers: nil, Containers: [ { Name: "volume-tester", Image: "registry.k8s.io/pause:3.7", Command: nil, Args: nil, WorkingDir: "", Ports: nil, EnvFrom: nil, Env: nil, Resources: {Limits: nil, Requests: nil}, VolumeMounts: [ { Name: "my-volume", ReadOnly: false, MountPath: "/mnt/test", SubPath: "", MountPropagation: nil, SubPathExpr: "", }, { Name: "kube-api-access-sn87r", ReadOnly: true, MountPath: "/var/run/secrets/kubernetes.io/serviceaccount", SubPath: "", MountPropagation: nil, SubPathExpr: "", }, ], VolumeDevices: nil, LivenessProbe: nil, ReadinessProbe: nil, StartupProbe: nil, Lifecycle: nil, TerminationMessagePath: "/dev/termination-log", TerminationMessagePolicy: "File", ImagePullPolicy: "IfNotPresent", SecurityContext: nil, Stdin: false, StdinOnce: false, TTY: false, }, ], EphemeralContainers: nil, RestartPolicy: "Never", TerminationGracePeriodSeconds: 30, ActiveDeadlineSeconds: nil, DNSPolicy: "ClusterFirst", NodeSelector: nil, ServiceAccountName: "default", DeprecatedServiceAccount: "default", AutomountServiceAccountToken: nil, NodeName: "bootstrap-e2e-minion-group-l6r5", HostNetwork: false, HostPID: false, HostIPC: false, ShareProcessNamespace: nil, SecurityContext: { SELinuxOptions: nil, WindowsOptions: nil, RunAsUser: nil, RunAsGroup: nil, RunAsNonRoot: nil, SupplementalGroups: nil, FSGroup: nil, Sysctls: nil, FSGroupChangePolicy: nil, SeccompProfile: nil, }, ImagePullSecrets: nil, Hostname: "", Subdomain: "", Affinity: { NodeAffinity: { RequiredDuringSchedulingIgnoredDuringExecution: { NodeSelectorTerms: [ { MatchExpressions: nil, MatchFields: [...], }, ], }, PreferredDuringSchedulingIgnoredDuringExecution: nil, }, PodAffinity: nil, PodAntiAffinity: nil, }, SchedulerName: "default-scheduler", Tolerations: [ { Key: "node.kubernetes.io/not-ready", Operator: "Exists", Value: "", Effect: "NoExecute", TolerationSeconds: 300, }, { Key: "node.kubernetes.io/unreachable", Operator: "Exists", Value: "", Effect: "NoExecute", TolerationSeconds: 300, }, ], HostAliases: nil, PriorityClassName: "", Priority: 0, DNSConfig: nil, ReadinessGates: nil, RuntimeClassName: nil, EnableServiceLinks: true, PreemptionPolicy: "PreemptLowerPriority", Overhead: nil, TopologySpreadConstraints: nil, SetHostnameAsFQDN: nil, OS: nil, }, Status: { Phase: "Pending", Conditions: [ { Type: "Initialized", Status: "True", LastProbeTime: { Time: {wall: 0, ext: 0, loc: nil}, }, LastTransitionTime: { Time: { wall: 0, ext: 63791834882, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, Reason: "", Message: "", }, { Type: "Ready", Status: "False", LastProbeTime: { Time: {wall: 0, ext: 0, loc: nil}, }, LastTransitionTime: { Time: { wall: 0, ext: 63791834882, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, Reason: "ContainersNotReady", Message: "containers with unready status: [volume-tester]", }, { Type: "ContainersReady", Status: "False", LastProbeTime: { Time: {wall: 0, ext: 0, loc: nil}, }, LastTransitionTime: { Time: { wall: 0, ext: 63791834882, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, Reason: "ContainersNotReady", Message: "containers with unready status: [volume-tester]", }, { Type: "PodScheduled", Status: "True", LastProbeTime: { Time: {wall: 0, ext: 0, loc: nil}, }, LastTransitionTime: { Time: { wall: 0, ext: 63791834782, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, Reason: "", Message: "", }, ], Message: "", Reason: "", NominatedNodeName: "", HostIP: "10.138.0.5", PodIP: "", PodIPs: nil, StartTime: { Time: { wall: 0, ext: 63791834882, loc: { name: "Local", zone: [ {name: "UTC", offset: 0, isDST: false}, ], tx: [ { when: -576460752303423488, index: 0, isstd: false, isutc: false, }, ], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: "UTC", offset: 0, isDST: false}, }, }, }, InitContainerStatuses: nil, ContainerStatuses: [ { Name: "volume-tester", State: { Waiting: { Reason: "ContainerCreating", Message: "", }, Running: nil, Terminated: nil, }, LastTerminationState: {Waiting: nil, Running: nil, Terminated: nil}, Ready: false, RestartCount: 0, Image: "registry.k8s.io/pause:3.7", ImageID: "", ContainerID: "", Started: false, }, ], QOSClass: "BestEffort", EphemeralContainerStatuses: nil, }, }, ], } Jun 26 10:11:22.392: FAIL: Failed to start pod: timed out while waiting for pod csi-mock-volumes-9260/pvc-volume-tester-qf9qg to be running: timed out while waiting for pod csi-mock-volumes-9260/pvc-volume-tester-qf9qg to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage.glob..func1.6.1() test/e2e/storage/csi_mock_volume.go:374 +0x213 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000b02820, 0x746f348) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting pod pvc-volume-tester-qf9qg Jun 26 10:11:22.392: INFO: Deleting pod "pvc-volume-tester-qf9qg" in namespace "csi-mock-volumes-9260" Jun 26 10:11:22.436: INFO: Wait up to 5m0s for pod "pvc-volume-tester-qf9qg" to be fully deleted �[1mSTEP�[0m: Deleting claim pvc-fgfwp Jun 26 10:12:22.619: INFO: Waiting up to 2m0s for PersistentVolume pvc-50cd52da-0f31-4938-a7ef-e23ca9a720c3 to get deleted Jun 26 10:12:22.657: INFO: PersistentVolume pvc-50cd52da-0f31-4938-a7ef-e23ca9a720c3 found and phase=Released (37.959254ms) Jun 26 10:12:24.704: INFO: PersistentVolume pvc-50cd52da-0f31-4938-a7ef-e23ca9a720c3 was removed �[1mSTEP�[0m: Deleting storageclass csi-mock-volumes-9260-sczzj8q �[1mSTEP�[0m: Cleaning up resources �[1mSTEP�[0m: deleting the test namespace: csi-mock-volumes-9260 �[1mSTEP�[0m: Waiting for namespaces [csi-mock-volumes-9260] to vanish �[1mSTEP�[0m: uninstalling csi mock driver Jun 26 10:12:32.919: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-9260-4323/csi-attacher Jun 26 10:12:32.963: INFO: deleting *v1.ClusterRole: external-attacher-runner-csi-mock-volumes-9260 Jun 26 10:12:33.013: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-csi-mock-volumes-9260 Jun 26 10:12:33.054: INFO: deleting *v1.Role: csi-mock-volumes-9260-4323/external-attacher-cfg-csi-mock-volumes-9260 Jun 26 10:12:33.101: INFO: deleting *v1.RoleBinding: csi-mock-volumes-9260-4323/csi-attacher-role-cfg Jun 26 10:12:33.143: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-9260-4323/csi-provisioner Jun 26 10:12:33.196: INFO: deleting *v1.ClusterRole: external-provisioner-runner-csi-mock-volumes-9260 Jun 26 10:12:33.248: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-csi-mock-volumes-9260 Jun 26 10:12:33.308: INFO: deleting *v1.Role: csi-mock-volumes-9260-4323/external-provisioner-cfg-csi-mock-volumes-9260 Jun 26 10:12:33.361: INFO: deleting *v1.RoleBinding: csi-mock-volumes-9260-4323/csi-provisioner-role-cfg Jun 26 10:12:33.399: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-9260-4323/csi-resizer Jun 26 10:12:33.438: INFO: deleting *v1.ClusterRole: external-resizer-runner-csi-mock-volumes-9260 Jun 26 10:12:33.482: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-csi-mock-volumes-9260 Jun 26 10:12:33.518: INFO: deleting *v1.Role: csi-mock-volumes-9260-4323/external-resizer-cfg-csi-mock-volumes-9260 Jun 26 10:12:33.555: INFO: deleting *v1.RoleBinding: csi-mock-volumes-9260-4323/csi-resizer-role-cfg Jun 26 10:12:33.591: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-9260-4323/csi-snapshotter Jun 26 10:12:33.630: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-csi-mock-volumes-9260 Jun 26 10:12:33.670: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-csi-mock-volumes-9260 Jun 26 10:12:33.707: INFO: deleting *v1.Role: csi-mock-volumes-9260-4323/external-snapshotter-leaderelection-csi-mock-volumes-9260 Jun 26 10:12:33.744: INFO: deleting *v1.RoleBinding: csi-mock-volumes-9260-4323/external-snapshotter-leaderelection Jun 26 10:12:33.789: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-9260-4323/csi-mock Jun 26 10:12:33.852: INFO: deleting *v1.ClusterRoleBinding: csi-controller-attacher-role-csi-mock-volumes-9260 Jun 26 10:12:33.942: INFO: deleting *v1.ClusterRoleBinding: csi-controller-provisioner-role-csi-mock-volumes-9260 Jun 26 10:12:34.138: INFO: deleting *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-csi-mock-volumes-9260 Jun 26 10:12:34.299: INFO: deleting *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-csi-mock-volumes-9260 Jun 26 10:12:34.529: INFO: deleting *v1.ClusterRoleBinding: csi-controller-resizer-role-csi-mock-volumes-9260 Jun 26 10:12:34.655: INFO: deleting *v1.ClusterRoleBinding: csi-controller-snapshotter-role-csi-mock-volumes-9260 Jun 26 10:12:34.747: INFO: deleting *v1.StorageClass: csi-mock-sc-csi-mock-volumes-9260 Jun 26 10:12:34.802: INFO: deleting *v1.StatefulSet: csi-mock-volumes-9260-4323/csi-mockplugin Jun 26 10:12:34.867: INFO: deleting *v1.CSIDriver: csi-mock-csi-mock-volumes-9260 �[1mSTEP�[0m: deleting the driver namespace: csi-mock-volumes-9260-4323 �[1mSTEP�[0m: Waiting for namespaces [csi-mock-volumes-9260-4323] to vanish [AfterEach] [sig-storage] CSI mock volume test/e2e/framework/framework.go:187 Jun 26 10:13:05.127: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Find csi-mock-volumes-9260/pvc-volume-tester-qf9qg mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\slocal\]\[LocalVolumeType\:\sblockfs\]\s\[Testpattern\:\sPre\-provisioned\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sexisting\ssingle\sfile\s\[LinuxOnly\]$'
test/e2e/storage/testsuites/subpath.go:221 Jun 26 10:12:26.462: expected pod "pod-subpath-test-preprovisionedpv-4fwl" success: timed out while waiting for pod provisioning-1050/pod-subpath-test-preprovisionedpv-4fwl to be Succeeded or Failed test/e2e/framework/util.go:769from junit_15.xml
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a secret. [Conformance]","total":-1,"completed":7,"skipped":41,"failed":0} [BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 26 10:06:04.857: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should support existing single file [LinuxOnly] test/e2e/storage/testsuites/subpath.go:221 Jun 26 10:06:05.210: INFO: In-tree plugin kubernetes.io/local-volume is not migrated, not validating any metrics �[1mSTEP�[0m: Creating block device on node "bootstrap-e2e-minion-group-l6r5" using path "/tmp/local-driver-55e87f20-eafb-4596-bede-2a8be907c5dd" Jun 26 10:06:05.255: INFO: Waiting up to 5m0s for pod "hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n" in namespace "provisioning-1050" to be "running" Jun 26 10:06:05.299: INFO: Pod "hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n": Phase="Pending", Reason="", readiness=false. Elapsed: 44.176547ms Jun 26 10:06:07.337: INFO: Pod "hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n": Phase="Pending", Reason="", readiness=false. Elapsed: 2.082405191s Jun 26 10:06:09.362: INFO: Pod "hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n": Phase="Running", Reason="", readiness=true. Elapsed: 4.106835364s Jun 26 10:06:09.362: INFO: Pod "hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n" satisfied condition "running" Jun 26 10:06:09.362: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-driver-55e87f20-eafb-4596-bede-2a8be907c5dd && dd if=/dev/zero of=/tmp/local-driver-55e87f20-eafb-4596-bede-2a8be907c5dd/file bs=4096 count=5120 && losetup -f /tmp/local-driver-55e87f20-eafb-4596-bede-2a8be907c5dd/file] Namespace:provisioning-1050 PodName:hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:09.362: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:09.363: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:09.363: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-1050/pods/hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-driver-55e87f20-eafb-4596-bede-2a8be907c5dd+%26%26+dd+if%3D%2Fdev%2Fzero+of%3D%2Ftmp%2Flocal-driver-55e87f20-eafb-4596-bede-2a8be907c5dd%2Ffile+bs%3D4096+count%3D5120+%26%26+losetup+-f+%2Ftmp%2Flocal-driver-55e87f20-eafb-4596-bede-2a8be907c5dd%2Ffile&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:06:09.906: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-driver-55e87f20-eafb-4596-bede-2a8be907c5dd/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:provisioning-1050 PodName:hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:09.906: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:09.907: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:09.907: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-1050/pods/hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-driver-55e87f20-eafb-4596-bede-2a8be907c5dd%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:06:10.429: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkfs -t ext4 /dev/loop6 && mount -t ext4 /dev/loop6 /tmp/local-driver-55e87f20-eafb-4596-bede-2a8be907c5dd && chmod o+rwx /tmp/local-driver-55e87f20-eafb-4596-bede-2a8be907c5dd] Namespace:provisioning-1050 PodName:hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:10.429: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:10.430: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:10.430: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-1050/pods/hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkfs+-t+ext4+%2Fdev%2Floop6+%26%26+mount+-t+ext4+%2Fdev%2Floop6+%2Ftmp%2Flocal-driver-55e87f20-eafb-4596-bede-2a8be907c5dd+%26%26+chmod+o%2Brwx+%2Ftmp%2Flocal-driver-55e87f20-eafb-4596-bede-2a8be907c5dd&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:06:11.105: INFO: Creating resource for pre-provisioned PV Jun 26 10:06:11.106: INFO: Creating PVC and PV �[1mSTEP�[0m: Creating a PVC followed by a PV Jun 26 10:06:11.330: INFO: Waiting for PV local-c9ntw to bind to PVC pvc-h6drt Jun 26 10:06:11.330: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-h6drt] to have phase Bound Jun 26 10:06:11.366: INFO: PersistentVolumeClaim pvc-h6drt found but phase is Pending instead of Bound. Jun 26 10:06:13.408: INFO: PersistentVolumeClaim pvc-h6drt found but phase is Pending instead of Bound. Jun 26 10:06:15.453: INFO: PersistentVolumeClaim pvc-h6drt found but phase is Pending instead of Bound. Jun 26 10:06:17.553: INFO: PersistentVolumeClaim pvc-h6drt found but phase is Pending instead of Bound. Jun 26 10:06:19.649: INFO: PersistentVolumeClaim pvc-h6drt found and phase=Bound (8.319113411s) Jun 26 10:06:19.649: INFO: Waiting up to 3m0s for PersistentVolume local-c9ntw to have phase Bound Jun 26 10:06:19.709: INFO: PersistentVolume local-c9ntw found and phase=Bound (60.393186ms) �[1mSTEP�[0m: Creating pod pod-subpath-test-preprovisionedpv-4fwl �[1mSTEP�[0m: Creating a pod to test subpath Jun 26 10:06:19.953: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-4fwl" in namespace "provisioning-1050" to be "Succeeded or Failed" Jun 26 10:06:20.037: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 83.168187ms Jun 26 10:06:22.081: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.127710467s Jun 26 10:06:24.073: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.119757471s Jun 26 10:06:26.109: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.155979121s Jun 26 10:06:28.079: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 8.125745041s Jun 26 10:06:30.074: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 10.120482055s Jun 26 10:06:32.074: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 12.120745501s Jun 26 10:06:34.077: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 14.123904204s Jun 26 10:06:36.076: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 16.122733413s Jun 26 10:06:38.074: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 18.120848974s Jun 26 10:06:40.074: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 20.120368916s Jun 26 10:06:42.072: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 22.118223292s Jun 26 10:06:44.073: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 24.119741537s Jun 26 10:06:46.087: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 26.133586798s Jun 26 10:06:48.076: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 28.122885205s Jun 26 10:06:50.082: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 30.128133695s Jun 26 10:06:52.081: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 32.127160182s Jun 26 10:06:54.077: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 34.123465435s Jun 26 10:06:56.091: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 36.137836638s Jun 26 10:06:58.093: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 38.139584119s Jun 26 10:07:00.100: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 40.146857065s Jun 26 10:07:02.091: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 42.137442696s Jun 26 10:07:04.091: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 44.138000083s Jun 26 10:07:06.089: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 46.135791378s Jun 26 10:07:08.089: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 48.135538891s Jun 26 10:07:10.121: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 50.168052881s Jun 26 10:07:12.112: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 52.158974756s Jun 26 10:07:14.104: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 54.15050541s Jun 26 10:07:16.127: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 56.173300298s Jun 26 10:07:18.099: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 58.145368235s Jun 26 10:07:20.225: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.271534924s Jun 26 10:07:22.089: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.135416535s Jun 26 10:07:24.084: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.130426411s Jun 26 10:07:26.114: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.160149339s Jun 26 10:07:28.141: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.187580152s Jun 26 10:07:30.090: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.136850409s Jun 26 10:07:32.093: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.140063068s Jun 26 10:07:34.099: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.145863738s Jun 26 10:07:36.150: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.196668403s Jun 26 10:07:38.109: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.155349696s Jun 26 10:07:40.085: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.131641147s Jun 26 10:07:42.088: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.134363485s Jun 26 10:07:44.108: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.154763799s Jun 26 10:07:46.138: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.184830313s Jun 26 10:07:48.101: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.147149409s Jun 26 10:07:50.097: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.143286117s Jun 26 10:07:52.099: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.145590738s Jun 26 10:07:54.099: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.145463723s Jun 26 10:07:56.097: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.143117606s Jun 26 10:07:58.099: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.145108879s Jun 26 10:08:00.091: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.137320988s Jun 26 10:08:02.157: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.20392034s Jun 26 10:08:04.077: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.123845109s Jun 26 10:08:06.108: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.15474909s Jun 26 10:08:08.081: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.127780388s Jun 26 10:08:10.074: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.120957688s Jun 26 10:08:12.086: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.132241569s Jun 26 10:08:14.084: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.130713491s Jun 26 10:08:16.080: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.126137928s Jun 26 10:08:18.077: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.12394062s Jun 26 10:08:20.097: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.143310244s Jun 26 10:08:22.128: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.174306662s Jun 26 10:08:24.142: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.18887839s Jun 26 10:08:26.137: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.183200952s Jun 26 10:08:28.131: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.177398327s Jun 26 10:08:30.148: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.194307174s Jun 26 10:08:32.182: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.229091017s Jun 26 10:08:34.174: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.220529517s Jun 26 10:08:36.100: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.146371118s Jun 26 10:08:38.111: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.157633253s Jun 26 10:08:40.137: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.18375054s Jun 26 10:08:42.185: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.231610365s Jun 26 10:08:44.153: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.199701046s Jun 26 10:08:46.118: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.164365044s Jun 26 10:08:48.089: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.136043862s Jun 26 10:08:50.113: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.15960228s Jun 26 10:08:52.109: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.155898003s Jun 26 10:08:54.132: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.179070182s Jun 26 10:08:56.120: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.166913235s Jun 26 10:08:58.092: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.138994934s Jun 26 10:09:00.075: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.121394996s Jun 26 10:09:02.077: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.123818747s Jun 26 10:09:04.113: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.159639172s Jun 26 10:09:06.075: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.121933968s Jun 26 10:09:08.076: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.122338939s Jun 26 10:09:10.083: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.129152284s Jun 26 10:09:12.161: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.207770143s Jun 26 10:09:14.195: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.241558921s Jun 26 10:09:16.097: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.143905926s Jun 26 10:09:18.081: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.127199433s Jun 26 10:09:20.185: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.231167587s Jun 26 10:09:22.161: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.207998474s Jun 26 10:09:24.266: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.313041377s Jun 26 10:09:26.126: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.172470971s Jun 26 10:09:28.098: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.144938801s Jun 26 10:09:30.127: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.173993134s Jun 26 10:09:32.166: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.21287219s Jun 26 10:09:34.261: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.307864144s Jun 26 10:09:36.094: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.140646323s Jun 26 10:09:38.091: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.137112845s Jun 26 10:09:40.079: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.125374658s Jun 26 10:09:42.098: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.144935796s Jun 26 10:09:44.075: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.121631028s Jun 26 10:09:46.080: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.126140653s Jun 26 10:09:48.082: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.128348632s Jun 26 10:09:50.078: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.124429439s Jun 26 10:09:52.088: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.134375939s Jun 26 10:09:54.075: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.121582028s Jun 26 10:09:56.130: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.1766926s Jun 26 10:09:58.073: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.12001432s Jun 26 10:10:00.113: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.1591611s Jun 26 10:10:02.130: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.176198381s Jun 26 10:10:04.113: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.159769108s Jun 26 10:10:06.078: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.124759867s Jun 26 10:10:08.085: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.131601955s Jun 26 10:10:10.089: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.135204599s Jun 26 10:10:12.197: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.244066215s Jun 26 10:10:14.099: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.145606209s Jun 26 10:10:16.088: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.134478407s Jun 26 10:10:18.074: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.120180755s Jun 26 10:10:20.078: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.124399702s Jun 26 10:10:22.140: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.186485557s Jun 26 10:10:24.074: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.121021933s Jun 26 10:10:26.098: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.14476116s Jun 26 10:10:28.099: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.145632488s Jun 26 10:10:30.074: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.121033017s Jun 26 10:10:32.098: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.144279685s Jun 26 10:10:34.124: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.170940309s Jun 26 10:10:36.190: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.236988484s Jun 26 10:10:38.085: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.131537063s Jun 26 10:10:40.074: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.12046123s Jun 26 10:10:42.098: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.144481281s Jun 26 10:10:44.100: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.146955234s Jun 26 10:10:46.176: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.222662661s Jun 26 10:10:48.081: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.127907961s Jun 26 10:10:50.075: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.121729363s Jun 26 10:10:52.084: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.130309281s Jun 26 10:10:54.115: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.161179494s Jun 26 10:10:56.073: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.1200319s Jun 26 10:10:58.091: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.137404144s Jun 26 10:11:00.074: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.121057637s Jun 26 10:11:02.079: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.125408825s Jun 26 10:11:04.082: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.129088188s Jun 26 10:11:06.074: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.120415178s Jun 26 10:11:08.077: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.123556554s Jun 26 10:11:10.083: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.130017143s Jun 26 10:11:12.204: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.250498482s Jun 26 10:11:14.090: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.136902891s Jun 26 10:11:16.084: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.131037804s Jun 26 10:11:18.075: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.121820459s Jun 26 10:11:20.085: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.131334175s Jun 26 10:11:20.122: INFO: Pod "pod-subpath-test-preprovisionedpv-4fwl": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.168131706s Jun 26 10:11:20.223: INFO: Failed to get logs from node "bootstrap-e2e-minion-group-l6r5" pod "pod-subpath-test-preprovisionedpv-4fwl" container "init-volume-preprovisionedpv-4fwl": the server rejected our request for an unknown reason (get pods pod-subpath-test-preprovisionedpv-4fwl) Jun 26 10:11:20.335: INFO: Failed to get logs from node "bootstrap-e2e-minion-group-l6r5" pod "pod-subpath-test-preprovisionedpv-4fwl" container "test-container-subpath-preprovisionedpv-4fwl": the server rejected our request for an unknown reason (get pods pod-subpath-test-preprovisionedpv-4fwl) �[1mSTEP�[0m: delete the pod Jun 26 10:11:20.382: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:20.421: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:22.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:22.461: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:24.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:24.458: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:26.423: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:26.461: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:28.421: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:28.460: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:30.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:30.458: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:32.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:32.621: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:34.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:34.467: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:36.423: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:36.460: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:38.421: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:38.462: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:40.423: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:40.460: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:42.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:42.462: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:44.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:44.458: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:46.423: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:46.459: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:48.421: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:48.457: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:50.423: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:50.462: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:52.430: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:52.465: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:54.423: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:54.459: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:56.423: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:56.477: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:11:58.421: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:11:58.458: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:00.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:00.466: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:02.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:02.460: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:04.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:04.484: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:06.424: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:06.460: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:08.421: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:08.464: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:10.423: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:10.470: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:12.421: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:12.459: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:14.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:14.615: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:16.421: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:16.507: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:18.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:18.459: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:20.421: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:20.633: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:22.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:22.489: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:24.422: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:24.458: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl still exists Jun 26 10:12:26.423: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-4fwl to disappear Jun 26 10:12:26.462: INFO: Pod pod-subpath-test-preprovisionedpv-4fwl no longer exists Jun 26 10:12:26.462: INFO: Unexpected error: <*errors.errorString | 0xc002a98a80>: { s: "expected pod \"pod-subpath-test-preprovisionedpv-4fwl\" success: timed out while waiting for pod provisioning-1050/pod-subpath-test-preprovisionedpv-4fwl to be Succeeded or Failed", } Jun 26 10:12:26.462: FAIL: expected pod "pod-subpath-test-preprovisionedpv-4fwl" success: timed out while waiting for pod provisioning-1050/pod-subpath-test-preprovisionedpv-4fwl to be Succeeded or Failed Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc003e74000?, {0x71c1381?, 0x0?}, 0xc003e74000, 0x0, {0xc002cbb100, 0x1, 0x1}, 0x0?) test/e2e/framework/util.go:769 +0x176 k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) test/e2e/framework/framework.go:581 k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc002cc9b80, {0xc003e3a4e0, 0x16}, 0xc003e74000, 0x0) test/e2e/storage/testsuites/subpath.go:693 +0x15c k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func5() test/e2e/storage/testsuites/subpath.go:229 +0x1ba k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000d2c9c0, 0x746f348) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting pod Jun 26 10:12:26.462: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-4fwl" in namespace "provisioning-1050" �[1mSTEP�[0m: Deleting pv and pvc Jun 26 10:12:26.504: INFO: Deleting PersistentVolumeClaim "pvc-h6drt" Jun 26 10:12:26.543: INFO: Deleting PersistentVolume "local-c9ntw" Jun 26 10:12:26.617: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c umount /tmp/local-driver-55e87f20-eafb-4596-bede-2a8be907c5dd] Namespace:provisioning-1050 PodName:hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:12:26.617: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:12:26.619: INFO: ExecWithOptions: Clientset creation Jun 26 10:12:26.619: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-1050/pods/hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=umount+%2Ftmp%2Flocal-driver-55e87f20-eafb-4596-bede-2a8be907c5dd&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:12:26.935: INFO: exec bootstrap-e2e-minion-group-l6r5: command: umount /tmp/local-driver-55e87f20-eafb-4596-bede-2a8be907c5dd Jun 26 10:12:26.935: INFO: exec bootstrap-e2e-minion-group-l6r5: stdout: "" Jun 26 10:12:26.935: INFO: exec bootstrap-e2e-minion-group-l6r5: stderr: "umount: /tmp/local-driver-55e87f20-eafb-4596-bede-2a8be907c5dd: no mount point specified.\n" Jun 26 10:12:26.935: INFO: exec bootstrap-e2e-minion-group-l6r5: exit code: 0 Jun 26 10:12:26.935: INFO: Unexpected error: <exec.CodeExitError>: { Err: { s: "command terminated with exit code 32", }, Code: 32, } Jun 26 10:12:26.936: FAIL: command terminated with exit code 32 Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).cleanupLocalVolumeBlockFS(0xc002c22210, 0xc001896180) test/e2e/storage/utils/local.go:192 +0xb0 k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).Remove(0x22?, 0xc00355a680?) test/e2e/storage/utils/local.go:353 +0xc5 k8s.io/kubernetes/test/e2e/storage/drivers.(*localVolume).DeleteVolume(0xc001fd0858?) test/e2e/storage/drivers/in_tree.go:1952 +0x28 k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0x7ac14c8?) test/e2e/storage/utils/utils.go:714 +0x6d k8s.io/kubernetes/test/e2e/storage/framework.(*VolumeResource).CleanupResource(0xc0016ce6c0) test/e2e/storage/framework/volume_resource.go:231 +0xc6d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func2() test/e2e/storage/testsuites/subpath.go:179 +0x12d panic({0x6d095c0, 0xc0035c1740}) /usr/local/go/src/runtime/panic.go:838 +0x207 k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1() test/e2e/framework/ginkgowrapper/wrapper.go:63 +0x7d panic({0x637daa0, 0x7a59950}) /usr/local/go/src/runtime/panic.go:838 +0x207 k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail({0xc000e64270, 0xc6}, {0xc001fd0f48?, 0x71b820b?, 0xc001fd0f68?}) test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x197 k8s.io/kubernetes/test/e2e/framework.Fail({0xc002860000, 0xb1}, {0xc001fd0fe0?, 0xc002860000?, 0xc001fd1008?}) test/e2e/framework/log.go:63 +0x145 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7a5d560, 0xc002a98a80}, {0x0?, 0xc001fd1100?, 0x1?}) test/e2e/framework/expect.go:76 +0x267 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) test/e2e/framework/expect.go:43 k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc003e74000?, {0x71c1381?, 0x0?}, 0xc003e74000, 0x0, {0xc002cbb100, 0x1, 0x1}, 0x0?) test/e2e/framework/util.go:769 +0x176 k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) test/e2e/framework/framework.go:581 k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc002cc9b80, {0xc003e3a4e0, 0x16}, 0xc003e74000, 0x0) test/e2e/storage/testsuites/subpath.go:693 +0x15c k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func5() test/e2e/storage/testsuites/subpath.go:229 +0x1ba k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000d2c9c0, 0x746f348) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting pod hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n in namespace provisioning-1050 [AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Collecting events from namespace "provisioning-1050". �[1mSTEP�[0m: Found 17 events. Jun 26 10:12:27.026: INFO: At 2022-06-26 10:06:05 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n: {default-scheduler } Scheduled: Successfully assigned provisioning-1050/hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n to bootstrap-e2e-minion-group-l6r5 Jun 26 10:12:27.026: INFO: At 2022-06-26 10:06:06 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n: {kubelet bootstrap-e2e-minion-group-l6r5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:12:27.026: INFO: At 2022-06-26 10:06:06 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n: {kubelet bootstrap-e2e-minion-group-l6r5} Created: Created container agnhost-container Jun 26 10:12:27.026: INFO: At 2022-06-26 10:06:06 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n: {kubelet bootstrap-e2e-minion-group-l6r5} Started: Started container agnhost-container Jun 26 10:12:27.026: INFO: At 2022-06-26 10:06:11 +0000 UTC - event for pvc-h6drt: {persistentvolume-controller } ProvisioningFailed: storageclass.storage.k8s.io "provisioning-1050" not found Jun 26 10:12:27.026: INFO: At 2022-06-26 10:06:19 +0000 UTC - event for pod-subpath-test-preprovisionedpv-4fwl: {default-scheduler } Scheduled: Successfully assigned provisioning-1050/pod-subpath-test-preprovisionedpv-4fwl to bootstrap-e2e-minion-group-l6r5 Jun 26 10:12:27.026: INFO: At 2022-06-26 10:06:59 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n: {node-controller } NodeNotReady: Node is not ready Jun 26 10:12:27.026: INFO: At 2022-06-26 10:08:05 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n: {kubelet bootstrap-e2e-minion-group-l6r5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:12:27.026: INFO: At 2022-06-26 10:08:05 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n: {kubelet bootstrap-e2e-minion-group-l6r5} Created: Created container agnhost-container Jun 26 10:12:27.026: INFO: At 2022-06-26 10:08:05 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n: {kubelet bootstrap-e2e-minion-group-l6r5} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jun 26 10:12:27.026: INFO: At 2022-06-26 10:08:06 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n: {kubelet bootstrap-e2e-minion-group-l6r5} Started: Started container agnhost-container Jun 26 10:12:27.026: INFO: At 2022-06-26 10:08:08 +0000 UTC - event for pod-subpath-test-preprovisionedpv-4fwl: {kubelet bootstrap-e2e-minion-group-l6r5} FailedMount: MountVolume.NewMounter initialization failed for volume "local-c9ntw" : path "/tmp/local-driver-55e87f20-eafb-4596-bede-2a8be907c5dd" does not exist Jun 26 10:12:27.026: INFO: At 2022-06-26 10:08:14 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod provisioning-1050/hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n Jun 26 10:12:27.026: INFO: At 2022-06-26 10:08:14 +0000 UTC - event for pod-subpath-test-preprovisionedpv-4fwl: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod provisioning-1050/pod-subpath-test-preprovisionedpv-4fwl Jun 26 10:12:27.026: INFO: At 2022-06-26 10:10:05 +0000 UTC - event for pod-subpath-test-preprovisionedpv-4fwl: {kubelet bootstrap-e2e-minion-group-l6r5} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume], unattached volumes=[test-volume liveness-probe-volume kube-api-access-5fx77]: timed out waiting for the condition Jun 26 10:12:27.026: INFO: At 2022-06-26 10:12:23 +0000 UTC - event for pod-subpath-test-preprovisionedpv-4fwl: {kubelet bootstrap-e2e-minion-group-l6r5} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume], unattached volumes=[kube-api-access-5fx77 test-volume liveness-probe-volume]: timed out waiting for the condition Jun 26 10:12:27.026: INFO: At 2022-06-26 10:12:26 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-l6r5-hsx5n: {kubelet bootstrap-e2e-minion-group-l6r5} Killing: Stopping container agnhost-container Jun 26 10:12:27.062: INFO: POD NODE PHASE GRACE CONDITIONS Jun 26 10:12:27.062: INFO: Jun 26 10:12:27.132: INFO: Logging node info for node bootstrap-e2e-master Jun 26 10:12:27.167: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 96f3154f-aacc-400a-ad66-d67f41c6b36b 18229 0 2022-06-26 10:01:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-06-26 10:11:47 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860045824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597901824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:11:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:11:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:11:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:11:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.168.138.173,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:948953d461317864b1fe4464d95c432a,SystemUUID:948953d4-6131-7864-b1fe-4464d95c432a,BootID:e5607f80-4a27-4601-af47-005a2514594d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:127703507,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:117521209,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:51075896,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:9870ed22905d03e3fa5cd2d57118784999fb581c49310f6cac0c3795bcdd7ee7 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.32],SizeBytes:17930113,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:12:27.168: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 26 10:12:27.224: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 26 10:12:27.303: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.303: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:12:27.303: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.303: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 26 10:12:27.303: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.303: INFO: Container kube-apiserver ready: true, restart count 0 Jun 26 10:12:27.303: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-26 10:00:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.303: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 26 10:12:27.303: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-26 10:00:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.303: INFO: Container l7-lb-controller ready: true, restart count 2 Jun 26 10:12:27.303: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.303: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:12:27.303: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.303: INFO: Container kube-scheduler ready: true, restart count 0 Jun 26 10:12:27.303: INFO: metadata-proxy-v0.1-79zmr started at 2022-06-26 10:01:13 +0000 UTC (0+2 container statuses recorded) Jun 26 10:12:27.303: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:12:27.303: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:12:27.303: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.304: INFO: Container kube-controller-manager ready: true, restart count 1 Jun 26 10:12:27.517: INFO: Latency metrics for node bootstrap-e2e-master Jun 26 10:12:27.517: INFO: Logging node info for node bootstrap-e2e-minion-group-kv80 Jun 26 10:12:27.566: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-kv80 8fe21414-4e64-490c-92b5-167dc1e64d0a 19665 0 2022-06-26 10:01:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-kv80 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-kv80 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5222":"bootstrap-e2e-minion-group-kv80","csi-hostpath-volume-9707":"bootstrap-e2e-minion-group-kv80"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-26 10:11:35 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:12:16 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-06-26 10:12:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-kv80,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:11:35 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:11:35 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:11:35 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:11:35 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:11:35 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:11:35 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:12:25 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:12:25 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:12:25 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:12:25 +0000 UTC,LastTransitionTime:2022-06-26 10:01:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.113.50,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b6c246299f5ddd34e63819759303fbd4,SystemUUID:b6c24629-9f5d-dd34-e638-19759303fbd4,BootID:b4e429f5-615d-4b99-b5eb-195153abb687,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5222^4a83c822-f538-11ec-bc13-92d6874b7cde kubernetes.io/csi/csi-hostpath-volume-9707^7394a3a3-f538-11ec-aa8f-8e9b4f8c9be5],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-9707^7394a3a3-f538-11ec-aa8f-8e9b4f8c9be5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5222^4a83c822-f538-11ec-bc13-92d6874b7cde,DevicePath:,},},Config:nil,},} Jun 26 10:12:27.567: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-kv80 Jun 26 10:12:27.658: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-kv80 Jun 26 10:12:27.913: INFO: pause-pod-1 started at 2022-06-26 10:11:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:12:27.913: INFO: hostpath-injector started at 2022-06-26 10:12:15 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container hostpath-injector ready: true, restart count 0 Jun 26 10:12:27.913: INFO: kube-proxy-bootstrap-e2e-minion-group-kv80 started at 2022-06-26 10:01:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:12:27.913: INFO: npd-v0.8.9-vsk67 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:12:27.913: INFO: netserver-0 started at 2022-06-26 10:11:59 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:27.913: INFO: csi-mockplugin-0 started at 2022-06-26 10:12:27 +0000 UTC (0+3 container statuses recorded) Jun 26 10:12:27.913: INFO: Container csi-provisioner ready: false, restart count 0 Jun 26 10:12:27.913: INFO: Container driver-registrar ready: false, restart count 0 Jun 26 10:12:27.913: INFO: Container mock ready: false, restart count 0 Jun 26 10:12:27.913: INFO: netserver-0 started at 2022-06-26 10:10:24 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:27.913: INFO: metadata-proxy-v0.1-glv9b started at 2022-06-26 10:01:12 +0000 UTC (0+2 container statuses recorded) Jun 26 10:12:27.913: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:12:27.913: INFO: coredns-85bc9d67b-2pcch started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container coredns ready: true, restart count 0 Jun 26 10:12:27.913: INFO: netserver-0 started at 2022-06-26 10:12:15 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:27.913: INFO: l7-default-backend-5f6f9745f9-95c2d started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container default-http-backend ready: true, restart count 0 Jun 26 10:12:27.913: INFO: konnectivity-agent-gh7lr started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:12:27.913: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:12:08 +0000 UTC (0+7 container statuses recorded) Jun 26 10:12:27.913: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:12:27.913: INFO: volume-snapshot-controller-0 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 26 10:12:27.913: INFO: inline-volume-tester-h8pdg started at 2022-06-26 10:11:06 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container csi-volume-tester ready: true, restart count 0 Jun 26 10:12:27.913: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:11:03 +0000 UTC (0+7 container statuses recorded) Jun 26 10:12:27.913: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:12:27.913: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:12:27.913: INFO: hostexec-bootstrap-e2e-minion-group-kv80-w6lsg started at 2022-06-26 10:12:21 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:27.913: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:12:28.222: INFO: Latency metrics for node bootstrap-e2e-minion-group-kv80 Jun 26 10:12:28.222: INFO: Logging node info for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:12:28.375: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l6r5 bcf9cd6e-4842-45b7-9f21-7de490b4df8c 18361 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l6r5 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l6r5 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5430":"bootstrap-e2e-minion-group-l6r5","csi-mock-csi-mock-volumes-9260":"bootstrap-e2e-minion-group-l6r5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:08:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-26 10:08:32 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:11:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-26 10:11:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{},"f:memory":{}},"f:capacity":{"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-l6r5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817142272 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554998272 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:08:32 +0000 UTC,LastTransitionTime:2022-06-26 10:08:31 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:08:32 +0000 UTC,LastTransitionTime:2022-06-26 10:08:31 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:08:32 +0000 UTC,LastTransitionTime:2022-06-26 10:08:31 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:08:32 +0000 UTC,LastTransitionTime:2022-06-26 10:08:31 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:08:32 +0000 UTC,LastTransitionTime:2022-06-26 10:08:30 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:08:32 +0000 UTC,LastTransitionTime:2022-06-26 10:08:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:11:47 +0000 UTC,LastTransitionTime:2022-06-26 10:08:01 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:11:47 +0000 UTC,LastTransitionTime:2022-06-26 10:08:01 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:11:47 +0000 UTC,LastTransitionTime:2022-06-26 10:08:01 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:11:47 +0000 UTC,LastTransitionTime:2022-06-26 10:08:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:35.227.167.115,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5bb667ad496693fbfa6f2dcbfb63cab,SystemUUID:f5bb667a-d496-693f-bfa6-f2dcbfb63cab,BootID:84299dcc-7058-447e-bb97-6e48fa6e8e2e,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-5430^222de8c7-f538-11ec-910d-5e543ae2a423],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:12:28.376: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:12:28.452: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l6r5 Jun 26 10:12:28.581: INFO: netserver-1 started at 2022-06-26 10:10:24 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:28.581: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:28.581: INFO: netserver-1 started at 2022-06-26 10:11:58 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:28.581: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:28.581: INFO: konnectivity-agent-jpkq2 started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:28.581: INFO: Container konnectivity-agent ready: true, restart count 1 Jun 26 10:12:28.581: INFO: csi-mockplugin-0 started at 2022-06-26 10:09:48 +0000 UTC (0+3 container statuses recorded) Jun 26 10:12:28.581: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:12:28.581: INFO: Container driver-registrar ready: true, restart count 0 Jun 26 10:12:28.581: INFO: Container mock ready: true, restart count 0 Jun 26 10:12:28.581: INFO: deployment-shared-map-item-removal-6c468f5898-hh5sm started at <nil> (0+0 container statuses recorded) Jun 26 10:12:28.581: INFO: e2e-mxzcs-wqphs started at <nil> (0+0 container statuses recorded) Jun 26 10:12:28.581: INFO: httpd started at 2022-06-26 10:12:21 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:28.581: INFO: Container httpd ready: false, restart count 0 Jun 26 10:12:28.581: INFO: csi-mockplugin-resizer-0 started at 2022-06-26 10:09:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:28.581: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:12:28.581: INFO: netserver-1 started at 2022-06-26 10:12:14 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:28.581: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:28.581: INFO: pod-subpath-test-inlinevolume-tj8j started at 2022-06-26 10:12:22 +0000 UTC (2+1 container statuses recorded) Jun 26 10:12:28.581: INFO: Init container init-volume-inlinevolume-tj8j ready: true, restart count 0 Jun 26 10:12:28.581: INFO: Init container test-init-volume-inlinevolume-tj8j ready: true, restart count 0 Jun 26 10:12:28.581: INFO: Container test-container-subpath-inlinevolume-tj8j ready: false, restart count 0 Jun 26 10:12:28.581: INFO: external-provisioner-n2dxq started at 2022-06-26 10:12:24 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:28.581: INFO: Container nfs-provisioner ready: true, restart count 0 Jun 26 10:12:28.582: INFO: metadata-proxy-v0.1-sxbmz started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:12:28.582: INFO: Container metadata-proxy ready: true, restart count 1 Jun 26 10:12:28.582: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jun 26 10:12:28.582: INFO: csi-mockplugin-0 started at 2022-06-26 10:06:14 +0000 UTC (0+3 container statuses recorded) Jun 26 10:12:28.582: INFO: Container csi-provisioner ready: true, restart count 1 Jun 26 10:12:28.582: INFO: Container driver-registrar ready: true, restart count 1 Jun 26 10:12:28.582: INFO: Container mock ready: true, restart count 1 Jun 26 10:12:28.582: INFO: csi-mockplugin-attacher-0 started at 2022-06-26 10:09:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:28.582: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:12:28.582: INFO: npd-v0.8.9-qnkkj started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:28.582: INFO: Container node-problem-detector ready: true, restart count 1 Jun 26 10:12:28.582: INFO: metrics-server-v0.5.2-755d66fb57-7m6vs started at 2022-06-26 10:01:37 +0000 UTC (0+2 container statuses recorded) Jun 26 10:12:28.582: INFO: Container metrics-server ready: true, restart count 2 Jun 26 10:12:28.582: INFO: Container metrics-server-nanny ready: true, restart count 1 Jun 26 10:12:28.582: INFO: kube-proxy-bootstrap-e2e-minion-group-l6r5 started at 2022-06-26 10:01:19 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:28.582: INFO: Container kube-proxy ready: true, restart count 1 Jun 26 10:12:29.756: INFO: Latency metrics for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:12:29.756: INFO: Logging node info for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:12:29.834: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-w1f4 aa1194c1-9599-41dd-8e29-c249fef7248e 19145 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-w1f4 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-w1f4 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:11:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:11:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-w1f4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:11:41 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:11:41 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:11:41 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:11:41 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:11:41 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:11:41 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:12:05 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:12:05 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:12:05 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:12:05 +0000 UTC,LastTransitionTime:2022-06-26 10:01:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.185.251.58,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38c15cfcea7d87fcfdfb495c46c9f2bd,SystemUUID:38c15cfc-ea7d-87fc-fdfb-495c46c9f2bd,BootID:f547655d-3f0b-4b8f-9e52-ac7560e71bb7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:12:29.834: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:12:29.935: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-w1f4 Jun 26 10:12:30.230: INFO: e2e-mxzcs-pgrj2 started at <nil> (0+0 container statuses recorded) Jun 26 10:12:30.230: INFO: netserver-2 started at 2022-06-26 10:11:59 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:30.230: INFO: netserver-2 started at 2022-06-26 10:12:15 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:30.230: INFO: npd-v0.8.9-hzvbm started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:12:30.230: INFO: netserver-2 started at 2022-06-26 10:10:25 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:30.230: INFO: webserver-pod started at 2022-06-26 10:11:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container agnhost ready: false, restart count 0 Jun 26 10:12:30.230: INFO: host-test-container-pod started at 2022-06-26 10:10:45 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:12:30.230: INFO: gluster-server started at 2022-06-26 10:12:14 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container gluster-server ready: true, restart count 0 Jun 26 10:12:30.230: INFO: metadata-proxy-v0.1-lj6mb started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:12:30.230: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:12:30.230: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:12:30.230: INFO: externalip-test-bw5wz started at 2022-06-26 10:12:25 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container externalip-test ready: true, restart count 0 Jun 26 10:12:30.230: INFO: pod-configmaps-bd09ae2a-b5c8-4122-b93c-1057faefaca4 started at 2022-06-26 10:11:40 +0000 UTC (0+3 container statuses recorded) Jun 26 10:12:30.230: INFO: Container createcm-volume-test ready: true, restart count 0 Jun 26 10:12:30.230: INFO: Container delcm-volume-test ready: true, restart count 0 Jun 26 10:12:30.230: INFO: Container updcm-volume-test ready: true, restart count 0 Jun 26 10:12:30.230: INFO: test-container-pod started at 2022-06-26 10:12:24 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:30.230: INFO: deployment-shared-map-item-removal-6c468f5898-gfcm8 started at 2022-06-26 10:12:27 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container nginx ready: false, restart count 0 Jun 26 10:12:30.230: INFO: kube-proxy-bootstrap-e2e-minion-group-w1f4 started at 2022-06-26 10:01:19 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:12:30.230: INFO: konnectivity-agent-8w8st started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:12:30.230: INFO: kube-dns-autoscaler-5477bd659c-hwxn2 started at 2022-06-26 10:06:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container autoscaler ready: true, restart count 0 Jun 26 10:12:30.230: INFO: liveness-0f865f43-33c2-4763-b351-c3bfcee4c023 started at 2022-06-26 10:09:10 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:12:30.230: INFO: rs-c4kqh started at <nil> (0+0 container statuses recorded) Jun 26 10:12:30.230: INFO: pod-ephm-test-projected-tqm9 started at 2022-06-26 10:10:41 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:30.230: INFO: Container test-container-subpath-projected-tqm9 ready: false, restart count 0 Jun 26 10:12:30.230: INFO: pfpod started at 2022-06-26 10:12:16 +0000 UTC (0+2 container statuses recorded) Jun 26 10:12:30.231: INFO: Container portforwardtester ready: true, restart count 0 Jun 26 10:12:30.231: INFO: Container readiness ready: true, restart count 0 Jun 26 10:12:31.025: INFO: Latency metrics for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:12:31.025: INFO: Logging node info for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:12:31.071: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-zvd6 465e1e7d-9f60-42b7-acea-e8cd1dca80e2 18157 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-zvd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-zvd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-26 10:10:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-26 10:11:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-zvd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:11:43 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:11:43 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:11:43 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:11:43 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:11:43 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:11:43 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:09:20 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:09:20 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:09:20 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:09:20 +0000 UTC,LastTransitionTime:2022-06-26 10:01:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.91.218,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aa6080e0da2673fad5141cc4863e32c,SystemUUID:4aa6080e-0da2-673f-ad51-41cc4863e32c,BootID:628a7f46-4bbe-40bc-aa89-4f2b41dd6222,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:12:31.071: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:12:31.149: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-zvd6 Jun 26 10:12:31.263: INFO: kube-proxy-bootstrap-e2e-minion-group-zvd6 started at 2022-06-26 10:01:20 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:12:31.263: INFO: external-provisioner-wtgcf started at 2022-06-26 10:12:00 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container nfs-provisioner ready: true, restart count 0 Jun 26 10:12:31.263: INFO: netserver-3 started at 2022-06-26 10:12:15 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container webserver ready: false, restart count 0 Jun 26 10:12:31.263: INFO: coredns-85bc9d67b-6grvl started at 2022-06-26 10:05:59 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container coredns ready: true, restart count 0 Jun 26 10:12:31.263: INFO: startup-7fd7ae17-366a-4512-8e9e-e7df0a2e4ecf started at 2022-06-26 10:11:20 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container busybox ready: true, restart count 0 Jun 26 10:12:31.263: INFO: npd-v0.8.9-w26wg started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:12:31.263: INFO: konnectivity-agent-thvrv started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:12:31.263: INFO: rs-q829v started at 2022-06-26 10:12:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container donothing ready: false, restart count 0 Jun 26 10:12:31.263: INFO: foo-kpqnn started at <nil> (0+0 container statuses recorded) Jun 26 10:12:31.263: INFO: hostpathsymlink-client started at 2022-06-26 10:12:03 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container hostpathsymlink-client ready: true, restart count 0 Jun 26 10:12:31.263: INFO: pod-subpath-test-inlinevolume-krst started at <nil> (0+0 container statuses recorded) Jun 26 10:12:31.263: INFO: inline-volume-tester-8p8kt started at 2022-06-26 10:12:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container csi-volume-tester ready: true, restart count 0 Jun 26 10:12:31.263: INFO: ss2-0 started at <nil> (0+0 container statuses recorded) Jun 26 10:12:31.263: INFO: externalip-test-pqhfg started at <nil> (0+0 container statuses recorded) Jun 26 10:12:31.263: INFO: test-container-pod started at 2022-06-26 10:10:45 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:31.263: INFO: deployment-shared-map-item-removal-6c468f5898-l2x8n started at <nil> (0+0 container statuses recorded) Jun 26 10:12:31.263: INFO: netserver-3 started at 2022-06-26 10:11:59 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:31.263: INFO: metadata-proxy-v0.1-hrd5b started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:12:31.263: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:12:31.263: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:12:31.263: INFO: pod-ready started at 2022-06-26 10:12:20 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container pod-readiness-gate ready: true, restart count 0 Jun 26 10:12:31.263: INFO: pod-projected-secrets-0aeab7e9-e54a-4055-a327-f6e8aa83afb8 started at 2022-06-26 10:12:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container projected-secret-volume-test ready: false, restart count 0 Jun 26 10:12:31.263: INFO: netserver-3 started at 2022-06-26 10:10:25 +0000 UTC (0+1 container statuses recorded) Jun 26 10:12:31.263: INFO: Container webserver ready: true, restart count 0 Jun 26 10:12:32.107: INFO: Latency metrics for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:12:32.107: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "provisioning-1050" for this suite.
Find pod-subpath-test-preprovisionedpv-4fwl mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\slocal\]\[LocalVolumeType\:\sblockfs\]\s\[Testpattern\:\sPre\-provisioned\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sreadOnly\sfile\sspecified\sin\sthe\svolumeMount\s\[LinuxOnly\]$'
test/e2e/storage/testsuites/subpath.go:382 Jun 26 10:07:17.450: error dialing backend: dial timeout, backstop test/e2e/storage/utils/local.go:162from junit_11.xml
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 26 10:06:11.569: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should support readOnly file specified in the volumeMount [LinuxOnly] test/e2e/storage/testsuites/subpath.go:382 Jun 26 10:06:11.916: INFO: In-tree plugin kubernetes.io/local-volume is not migrated, not validating any metrics �[1mSTEP�[0m: Creating block device on node "bootstrap-e2e-minion-group-kv80" using path "/tmp/local-driver-f2758979-dba9-473a-be64-6ffa834f2a61" Jun 26 10:06:11.959: INFO: Waiting up to 5m0s for pod "hostexec-bootstrap-e2e-minion-group-kv80-9pdp9" in namespace "provisioning-9335" to be "running" Jun 26 10:06:11.999: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-9pdp9": Phase="Pending", Reason="", readiness=false. Elapsed: 39.745624ms Jun 26 10:06:14.076: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-9pdp9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.116239022s Jun 26 10:06:16.041: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-9pdp9": Phase="Pending", Reason="", readiness=false. Elapsed: 4.081567953s Jun 26 10:06:18.056: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-9pdp9": Phase="Pending", Reason="", readiness=false. Elapsed: 6.096126758s Jun 26 10:06:20.068: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-9pdp9": Phase="Running", Reason="", readiness=true. Elapsed: 8.108947716s Jun 26 10:06:20.068: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-9pdp9" satisfied condition "running" Jun 26 10:06:20.068: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-driver-f2758979-dba9-473a-be64-6ffa834f2a61 && dd if=/dev/zero of=/tmp/local-driver-f2758979-dba9-473a-be64-6ffa834f2a61/file bs=4096 count=5120 && losetup -f /tmp/local-driver-f2758979-dba9-473a-be64-6ffa834f2a61/file] Namespace:provisioning-9335 PodName:hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:20.068: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:20.069: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:20.069: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-9335/pods/hostexec-bootstrap-e2e-minion-group-kv80-9pdp9/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-driver-f2758979-dba9-473a-be64-6ffa834f2a61+%26%26+dd+if%3D%2Fdev%2Fzero+of%3D%2Ftmp%2Flocal-driver-f2758979-dba9-473a-be64-6ffa834f2a61%2Ffile+bs%3D4096+count%3D5120+%26%26+losetup+-f+%2Ftmp%2Flocal-driver-f2758979-dba9-473a-be64-6ffa834f2a61%2Ffile&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:06:20.551: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-driver-f2758979-dba9-473a-be64-6ffa834f2a61/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:provisioning-9335 PodName:hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:20.552: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:20.552: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:20.552: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-9335/pods/hostexec-bootstrap-e2e-minion-group-kv80-9pdp9/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-driver-f2758979-dba9-473a-be64-6ffa834f2a61%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:06:20.963: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkfs -t ext4 /dev/loop4 && mount -t ext4 /dev/loop4 /tmp/local-driver-f2758979-dba9-473a-be64-6ffa834f2a61 && chmod o+rwx /tmp/local-driver-f2758979-dba9-473a-be64-6ffa834f2a61] Namespace:provisioning-9335 PodName:hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:20.963: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:20.964: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:20.964: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-9335/pods/hostexec-bootstrap-e2e-minion-group-kv80-9pdp9/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkfs+-t+ext4+%2Fdev%2Floop4+%26%26+mount+-t+ext4+%2Fdev%2Floop4+%2Ftmp%2Flocal-driver-f2758979-dba9-473a-be64-6ffa834f2a61+%26%26+chmod+o%2Brwx+%2Ftmp%2Flocal-driver-f2758979-dba9-473a-be64-6ffa834f2a61&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:06:21.477: INFO: Creating resource for pre-provisioned PV Jun 26 10:06:21.477: INFO: Creating PVC and PV �[1mSTEP�[0m: Creating a PVC followed by a PV Jun 26 10:06:21.557: INFO: Waiting for PV local-stdvp to bind to PVC pvc-wt6mq Jun 26 10:06:21.557: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-wt6mq] to have phase Bound Jun 26 10:06:21.595: INFO: PersistentVolumeClaim pvc-wt6mq found but phase is Pending instead of Bound. Jun 26 10:06:23.631: INFO: PersistentVolumeClaim pvc-wt6mq found but phase is Pending instead of Bound. Jun 26 10:06:25.667: INFO: PersistentVolumeClaim pvc-wt6mq found but phase is Pending instead of Bound. Jun 26 10:06:27.704: INFO: PersistentVolumeClaim pvc-wt6mq found but phase is Pending instead of Bound. Jun 26 10:06:29.740: INFO: PersistentVolumeClaim pvc-wt6mq found but phase is Pending instead of Bound. Jun 26 10:06:31.778: INFO: PersistentVolumeClaim pvc-wt6mq found but phase is Pending instead of Bound. Jun 26 10:06:33.865: INFO: PersistentVolumeClaim pvc-wt6mq found but phase is Pending instead of Bound. Jun 26 10:06:35.908: INFO: PersistentVolumeClaim pvc-wt6mq found and phase=Bound (14.350756159s) Jun 26 10:06:35.908: INFO: Waiting up to 3m0s for PersistentVolume local-stdvp to have phase Bound Jun 26 10:06:35.943: INFO: PersistentVolume local-stdvp found and phase=Bound (35.02392ms) �[1mSTEP�[0m: Creating pod pod-subpath-test-preprovisionedpv-lh8w �[1mSTEP�[0m: Creating a pod to test subpath Jun 26 10:06:36.055: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-lh8w" in namespace "provisioning-9335" to be "Succeeded or Failed" Jun 26 10:06:36.090: INFO: Pod "pod-subpath-test-preprovisionedpv-lh8w": Phase="Pending", Reason="", readiness=false. Elapsed: 34.767138ms Jun 26 10:06:38.127: INFO: Pod "pod-subpath-test-preprovisionedpv-lh8w": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071211785s Jun 26 10:06:40.126: INFO: Pod "pod-subpath-test-preprovisionedpv-lh8w": Phase="Pending", Reason="", readiness=false. Elapsed: 4.070706193s Jun 26 10:06:42.127: INFO: Pod "pod-subpath-test-preprovisionedpv-lh8w": Phase="Pending", Reason="", readiness=false. Elapsed: 6.071353292s Jun 26 10:06:44.128: INFO: Pod "pod-subpath-test-preprovisionedpv-lh8w": Phase="Pending", Reason="", readiness=false. Elapsed: 8.072598385s Jun 26 10:06:46.128: INFO: Pod "pod-subpath-test-preprovisionedpv-lh8w": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.072191644s �[1mSTEP�[0m: Saw pod success Jun 26 10:06:46.128: INFO: Pod "pod-subpath-test-preprovisionedpv-lh8w" satisfied condition "Succeeded or Failed" Jun 26 10:06:46.182: INFO: Trying to get logs from node bootstrap-e2e-minion-group-kv80 pod pod-subpath-test-preprovisionedpv-lh8w container test-container-subpath-preprovisionedpv-lh8w: <nil> �[1mSTEP�[0m: delete the pod Jun 26 10:06:46.329: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-lh8w to disappear Jun 26 10:06:46.370: INFO: Pod pod-subpath-test-preprovisionedpv-lh8w no longer exists �[1mSTEP�[0m: Deleting pod pod-subpath-test-preprovisionedpv-lh8w Jun 26 10:06:46.370: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-lh8w" in namespace "provisioning-9335" �[1mSTEP�[0m: Deleting pod Jun 26 10:06:46.406: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-lh8w" in namespace "provisioning-9335" �[1mSTEP�[0m: Deleting pv and pvc Jun 26 10:06:46.446: INFO: Deleting PersistentVolumeClaim "pvc-wt6mq" Jun 26 10:06:46.492: INFO: Deleting PersistentVolume "local-stdvp" Jun 26 10:06:46.539: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c umount /tmp/local-driver-f2758979-dba9-473a-be64-6ffa834f2a61] Namespace:provisioning-9335 PodName:hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:46.539: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:46.540: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:46.540: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-9335/pods/hostexec-bootstrap-e2e-minion-group-kv80-9pdp9/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=umount+%2Ftmp%2Flocal-driver-f2758979-dba9-473a-be64-6ffa834f2a61&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:06:47.006: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-driver-f2758979-dba9-473a-be64-6ffa834f2a61/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:provisioning-9335 PodName:hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:47.006: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:47.008: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:47.008: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-9335/pods/hostexec-bootstrap-e2e-minion-group-kv80-9pdp9/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-driver-f2758979-dba9-473a-be64-6ffa834f2a61%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) �[1mSTEP�[0m: Tear down block device "/dev/loop4" on node "bootstrap-e2e-minion-group-kv80" at path /tmp/local-driver-f2758979-dba9-473a-be64-6ffa834f2a61/file Jun 26 10:06:47.331: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c losetup -d /dev/loop4] Namespace:provisioning-9335 PodName:hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:47.331: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:47.332: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:47.332: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-9335/pods/hostexec-bootstrap-e2e-minion-group-kv80-9pdp9/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=losetup+-d+%2Fdev%2Floop4&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:07:17.449: INFO: exec bootstrap-e2e-minion-group-kv80: command: losetup -d /dev/loop4 Jun 26 10:07:17.449: INFO: exec bootstrap-e2e-minion-group-kv80: stdout: "" Jun 26 10:07:17.449: INFO: exec bootstrap-e2e-minion-group-kv80: stderr: "" Jun 26 10:07:17.449: INFO: exec bootstrap-e2e-minion-group-kv80: exit code: 0 Jun 26 10:07:17.449: INFO: Unexpected error: <*errors.StatusError | 0xc000d361e0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } Jun 26 10:07:17.449: FAIL: error dialing backend: dial timeout, backstop Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).teardownLoopDevice(0xc00354d920, {0xc00372b300, 0x36}, 0xc001f8ec00) test/e2e/storage/utils/local.go:162 +0x176 k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).cleanupLocalVolumeBlock(0xc00354d920, 0xc00062b800) test/e2e/storage/utils/local.go:167 +0x36 k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).cleanupLocalVolumeBlockFS(0xc00354d920, 0xc00062b800) test/e2e/storage/utils/local.go:193 +0xbf k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).Remove(0x22?, 0xc00063a270?) test/e2e/storage/utils/local.go:353 +0xc5 k8s.io/kubernetes/test/e2e/storage/drivers.(*localVolume).DeleteVolume(0xc0020acea8?) test/e2e/storage/drivers/in_tree.go:1952 +0x28 k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0x7ac14c8?) test/e2e/storage/utils/utils.go:714 +0x6d k8s.io/kubernetes/test/e2e/storage/framework.(*VolumeResource).CleanupResource(0xc0032f3680) test/e2e/storage/framework/volume_resource.go:231 +0xc6d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func2() test/e2e/storage/testsuites/subpath.go:179 +0x12d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func17() test/e2e/storage/testsuites/subpath.go:395 +0x203 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x2501d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0006d9380, 0x746f348) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting pod hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 in namespace provisioning-9335 [AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Collecting events from namespace "provisioning-9335". �[1mSTEP�[0m: Found 16 events. Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:11 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-9pdp9: {default-scheduler } Scheduled: Successfully assigned provisioning-9335/hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 to bootstrap-e2e-minion-group-kv80 Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:13 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-9pdp9: {kubelet bootstrap-e2e-minion-group-kv80} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:13 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-9pdp9: {kubelet bootstrap-e2e-minion-group-kv80} Created: Created container agnhost-container Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:13 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-9pdp9: {kubelet bootstrap-e2e-minion-group-kv80} Started: Started container agnhost-container Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:21 +0000 UTC - event for pvc-wt6mq: {persistentvolume-controller } ProvisioningFailed: storageclass.storage.k8s.io "provisioning-9335" not found Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:36 +0000 UTC - event for pod-subpath-test-preprovisionedpv-lh8w: {default-scheduler } Scheduled: Successfully assigned provisioning-9335/pod-subpath-test-preprovisionedpv-lh8w to bootstrap-e2e-minion-group-kv80 Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:39 +0000 UTC - event for pod-subpath-test-preprovisionedpv-lh8w: {kubelet bootstrap-e2e-minion-group-kv80} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:39 +0000 UTC - event for pod-subpath-test-preprovisionedpv-lh8w: {kubelet bootstrap-e2e-minion-group-kv80} Created: Created container init-volume-preprovisionedpv-lh8w Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:39 +0000 UTC - event for pod-subpath-test-preprovisionedpv-lh8w: {kubelet bootstrap-e2e-minion-group-kv80} Started: Started container init-volume-preprovisionedpv-lh8w Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:40 +0000 UTC - event for pod-subpath-test-preprovisionedpv-lh8w: {kubelet bootstrap-e2e-minion-group-kv80} Created: Created container test-init-volume-preprovisionedpv-lh8w Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:40 +0000 UTC - event for pod-subpath-test-preprovisionedpv-lh8w: {kubelet bootstrap-e2e-minion-group-kv80} Started: Started container test-init-volume-preprovisionedpv-lh8w Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:40 +0000 UTC - event for pod-subpath-test-preprovisionedpv-lh8w: {kubelet bootstrap-e2e-minion-group-kv80} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:41 +0000 UTC - event for pod-subpath-test-preprovisionedpv-lh8w: {kubelet bootstrap-e2e-minion-group-kv80} Started: Started container test-container-subpath-preprovisionedpv-lh8w Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:41 +0000 UTC - event for pod-subpath-test-preprovisionedpv-lh8w: {kubelet bootstrap-e2e-minion-group-kv80} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:07:17.678: INFO: At 2022-06-26 10:06:41 +0000 UTC - event for pod-subpath-test-preprovisionedpv-lh8w: {kubelet bootstrap-e2e-minion-group-kv80} Created: Created container test-container-subpath-preprovisionedpv-lh8w Jun 26 10:07:17.678: INFO: At 2022-06-26 10:07:17 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-9pdp9: {kubelet bootstrap-e2e-minion-group-kv80} Killing: Stopping container agnhost-container Jun 26 10:07:17.733: INFO: POD NODE PHASE GRACE CONDITIONS Jun 26 10:07:17.733: INFO: Jun 26 10:07:17.821: INFO: Logging node info for node bootstrap-e2e-master Jun 26 10:07:17.877: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 96f3154f-aacc-400a-ad66-d67f41c6b36b 9275 0 2022-06-26 10:01:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860045824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597901824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.168.138.173,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:948953d461317864b1fe4464d95c432a,SystemUUID:948953d4-6131-7864-b1fe-4464d95c432a,BootID:e5607f80-4a27-4601-af47-005a2514594d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:127703507,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:117521209,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:51075896,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:9870ed22905d03e3fa5cd2d57118784999fb581c49310f6cac0c3795bcdd7ee7 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.32],SizeBytes:17930113,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:17.878: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 26 10:07:17.934: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 26 10:07:18.080: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.080: INFO: Container kube-controller-manager ready: true, restart count 1 Jun 26 10:07:18.080: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.080: INFO: Container kube-scheduler ready: true, restart count 0 Jun 26 10:07:18.080: INFO: metadata-proxy-v0.1-79zmr started at 2022-06-26 10:01:13 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:18.080: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:18.080: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:18.080: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.080: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:18.080: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.080: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:18.080: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.080: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 26 10:07:18.080: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.080: INFO: Container kube-apiserver ready: true, restart count 0 Jun 26 10:07:18.080: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-26 10:00:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.080: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 26 10:07:18.080: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-26 10:00:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.080: INFO: Container l7-lb-controller ready: true, restart count 2 Jun 26 10:07:18.409: INFO: Latency metrics for node bootstrap-e2e-master Jun 26 10:07:18.409: INFO: Logging node info for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:18.458: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-kv80 8fe21414-4e64-490c-92b5-167dc1e64d0a 9403 0 2022-06-26 10:01:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-kv80 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-kv80 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:06:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:34 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-kv80,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.113.50,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b6c246299f5ddd34e63819759303fbd4,SystemUUID:b6c24629-9f5d-dd34-e638-19759303fbd4,BootID:b4e429f5-615d-4b99-b5eb-195153abb687,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:18.459: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:18.514: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:18.611: INFO: volume-snapshot-controller-0 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.611: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 26 10:07:18.611: INFO: execpod-affinityt97jd started at 2022-06-26 10:06:40 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.611: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:18.611: INFO: hostexec-bootstrap-e2e-minion-group-kv80-ssdb5 started at 2022-06-26 10:06:08 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.611: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:18.611: INFO: affinity-nodeport-timeout-2259x started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.611: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:18.611: INFO: kube-proxy-bootstrap-e2e-minion-group-kv80 started at 2022-06-26 10:01:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.611: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:18.611: INFO: npd-v0.8.9-vsk67 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.611: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:18.611: INFO: dns-test-3c2cd7d3-edb0-4970-a414-32648a9f811e started at 2022-06-26 10:06:43 +0000 UTC (0+3 container statuses recorded) Jun 26 10:07:18.611: INFO: Container jessie-querier ready: true, restart count 0 Jun 26 10:07:18.611: INFO: Container querier ready: true, restart count 0 Jun 26 10:07:18.611: INFO: Container webserver ready: true, restart count 0 Jun 26 10:07:18.611: INFO: pfpod started at 2022-06-26 10:06:51 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:18.611: INFO: Container portforwardtester ready: false, restart count 0 Jun 26 10:07:18.611: INFO: Container readiness ready: false, restart count 0 Jun 26 10:07:18.611: INFO: deployment-5cd6f9c8c9-pm2kh started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.611: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:18.611: INFO: metadata-proxy-v0.1-glv9b started at 2022-06-26 10:01:12 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:18.611: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:18.611: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:18.611: INFO: coredns-85bc9d67b-2pcch started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.611: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:18.611: INFO: l7-default-backend-5f6f9745f9-95c2d started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.611: INFO: Container default-http-backend ready: true, restart count 0 Jun 26 10:07:18.611: INFO: konnectivity-agent-gh7lr started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.611: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:18.611: INFO: deployment-6c468f5898-sqsr7 started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:18.611: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:18.913: INFO: Latency metrics for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:18.914: INFO: Logging node info for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:18.962: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l6r5 bcf9cd6e-4842-45b7-9f21-7de490b4df8c 9626 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l6r5 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l6r5 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6165":"bootstrap-e2e-minion-group-l6r5","csi-mock-csi-mock-volumes-9260":"bootstrap-e2e-minion-group-l6r5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-06-26 10:01:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:07:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} }]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-l6r5,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-06-26 10:06:59 +0000 UTC,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoExecute,TimeAdded:2022-06-26 10:07:04 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:35.227.167.115,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5bb667ad496693fbfa6f2dcbfb63cab,SystemUUID:f5bb667a-d496-693f-bfa6-f2dcbfb63cab,BootID:730f0552-4b2a-4a66-b12d-5824a7e7a976,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858,DevicePath:,},},Config:nil,},} Jun 26 10:07:18.962: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:19.052: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:19.293: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l6r5: error trying to reach service: dial tcp 10.138.0.5:10250: connect: connection refused Jun 26 10:07:19.293: INFO: Logging node info for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:19.430: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-w1f4 aa1194c1-9599-41dd-8e29-c249fef7248e 9523 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-w1f4 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-w1f4 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:04:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-w1f4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.185.251.58,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38c15cfcea7d87fcfdfb495c46c9f2bd,SystemUUID:38c15cfc-ea7d-87fc-fdfb-495c46c9f2bd,BootID:f547655d-3f0b-4b8f-9e52-ac7560e71bb7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:19.431: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:19.547: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:19.815: INFO: service-headless-toggled-flcct started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.815: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:19.815: INFO: npd-v0.8.9-hzvbm started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.815: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:19.815: INFO: liveness-1ffb8679-e880-42c5-9594-e7ce6b90aafe started at 2022-06-26 10:04:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.815: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:19.816: INFO: rand-non-local-gxjbx started at 2022-06-26 10:07:01 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container c ready: false, restart count 0 Jun 26 10:07:19.816: INFO: kube-dns-autoscaler-5477bd659c-hwxn2 started at 2022-06-26 10:06:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container autoscaler ready: true, restart count 0 Jun 26 10:07:19.816: INFO: hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc started at 2022-06-26 10:06:27 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:19.816: INFO: metadata-proxy-v0.1-lj6mb started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:19.816: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:19.816: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:19.816: INFO: rand-non-local-9thk7 started at 2022-06-26 10:06:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container c ready: false, restart count 0 Jun 26 10:07:19.816: INFO: test-grpc-0024d73f-6f4d-4e93-a689-31d246e3fd09 started at 2022-06-26 10:05:32 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container etcd ready: true, restart count 0 Jun 26 10:07:19.816: INFO: hairpin started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:19.816: INFO: rand-non-local-rcw7v started at 2022-06-26 10:06:45 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container c ready: false, restart count 0 Jun 26 10:07:19.816: INFO: verify-service-up-host-exec-pod started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:19.816: INFO: kube-proxy-bootstrap-e2e-minion-group-w1f4 started at 2022-06-26 10:01:19 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:19.816: INFO: konnectivity-agent-8w8st started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:19.816: INFO: service-headless-rfn2p started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:19.816: INFO: affinity-nodeport-timeout-pf8ht started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:19.816: INFO: pod-projected-secrets-d0859f57-a6b7-4b81-be26-970fd1a684b4 started at 2022-06-26 10:05:58 +0000 UTC (0+3 container statuses recorded) Jun 26 10:07:19.816: INFO: Container creates-volume-test ready: true, restart count 0 Jun 26 10:07:19.816: INFO: Container dels-volume-test ready: true, restart count 0 Jun 26 10:07:19.816: INFO: Container upds-volume-test ready: true, restart count 0 Jun 26 10:07:19.816: INFO: deployment-5cd6f9c8c9-2s82l started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:19.816: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:20.365: INFO: Latency metrics for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:20.366: INFO: Logging node info for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:20.484: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-zvd6 465e1e7d-9f60-42b7-acea-e8cd1dca80e2 9527 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-zvd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-zvd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2385":"bootstrap-e2e-minion-group-zvd6","csi-hostpath-provisioning-6151":"bootstrap-e2e-minion-group-zvd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-26 10:06:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-zvd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.91.218,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aa6080e0da2673fad5141cc4863e32c,SystemUUID:4aa6080e-0da2-673f-ad51-41cc4863e32c,BootID:628a7f46-4bbe-40bc-aa89-4f2b41dd6222,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62,DevicePath:,},},Config:nil,},} Jun 26 10:07:20.484: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:20.540: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:20.654: INFO: default started at 2022-06-26 10:06:44 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:20.654: INFO: affinity-nodeport-timeout-4b548 started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:20.654: INFO: metadata-proxy-v0.1-hrd5b started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:20.654: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:20.654: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:06:28 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:20.654: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:20.654: INFO: verify-service-up-exec-pod-85m6b started at 2022-06-26 10:06:26 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:20.654: INFO: coredns-85bc9d67b-6grvl started at 2022-06-26 10:05:59 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:20.654: INFO: hostexec-bootstrap-e2e-minion-group-zvd6-mmznv started at 2022-06-26 10:07:18 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:20.654: INFO: private started at 2022-06-26 10:06:42 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:20.654: INFO: kube-proxy-bootstrap-e2e-minion-group-zvd6 started at 2022-06-26 10:01:20 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:20.654: INFO: npd-v0.8.9-w26wg started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:20.654: INFO: konnectivity-agent-thvrv started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:20.654: INFO: inline-volume-tester-nkqft started at 2022-06-26 10:05:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container csi-volume-tester ready: true, restart count 0 Jun 26 10:07:20.654: INFO: service-headless-toggled-27ccn started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:20.654: INFO: service-headless-lrtx9 started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:20.654: INFO: master started at 2022-06-26 10:06:35 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:20.654: INFO: adopt-release-brsdt started at 2022-06-26 10:06:21 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container c ready: false, restart count 0 Jun 26 10:07:20.654: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:05:43 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:20.654: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:20.654: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:20.654: INFO: slave started at 2022-06-26 10:06:39 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.654: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:20.992: INFO: Latency metrics for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:20.992: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready Jun 26 10:07:21.066: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:23.180: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:25.182: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:27.185: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:29.180: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:31.225: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:33.179: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:35.177: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:37.193: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:39.188: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:41.180: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:43.203: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:45.181: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:47.185: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:49.189: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:51.173: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:53.183: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:55.199: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:57.190: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:59.205: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:08:01.181: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:03.172: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:05.170: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:07.174: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:09.172: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:11.172: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:13.189: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure �[1mSTEP�[0m: Destroying namespace "provisioning-9335" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\slocal\]\[LocalVolumeType\:\sdir\-bindmounted\]\s\[Testpattern\:\sPre\-provisioned\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sfile\sas\ssubpath\s\[LinuxOnly\]$'
test/e2e/storage/testsuites/subpath.go:232 Jun 26 10:07:20.402: error dialing backend: dial timeout, backstop test/e2e/storage/utils/local.go:251from junit_27.xml
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 26 10:06:07.814: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should support file as subpath [LinuxOnly] test/e2e/storage/testsuites/subpath.go:232 Jun 26 10:06:08.412: INFO: In-tree plugin kubernetes.io/local-volume is not migrated, not validating any metrics Jun 26 10:06:08.756: INFO: Waiting up to 5m0s for pod "hostexec-bootstrap-e2e-minion-group-kv80-ssdb5" in namespace "provisioning-3835" to be "running" Jun 26 10:06:08.855: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-ssdb5": Phase="Pending", Reason="", readiness=false. Elapsed: 98.951779ms Jun 26 10:06:10.899: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-ssdb5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.142710223s Jun 26 10:06:12.892: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-ssdb5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.13570935s Jun 26 10:06:14.895: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-ssdb5": Phase="Running", Reason="", readiness=true. Elapsed: 6.138931245s Jun 26 10:06:14.895: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-ssdb5" satisfied condition "running" Jun 26 10:06:14.895: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir /tmp/local-driver-9e778353-238c-4f66-89bf-8e9194d79349 && mount --bind /tmp/local-driver-9e778353-238c-4f66-89bf-8e9194d79349 /tmp/local-driver-9e778353-238c-4f66-89bf-8e9194d79349] Namespace:provisioning-3835 PodName:hostexec-bootstrap-e2e-minion-group-kv80-ssdb5 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:14.895: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:14.897: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:14.897: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-3835/pods/hostexec-bootstrap-e2e-minion-group-kv80-ssdb5/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+%2Ftmp%2Flocal-driver-9e778353-238c-4f66-89bf-8e9194d79349+%26%26+mount+--bind+%2Ftmp%2Flocal-driver-9e778353-238c-4f66-89bf-8e9194d79349+%2Ftmp%2Flocal-driver-9e778353-238c-4f66-89bf-8e9194d79349&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:06:15.240: INFO: Creating resource for pre-provisioned PV Jun 26 10:06:15.240: INFO: Creating PVC and PV �[1mSTEP�[0m: Creating a PVC followed by a PV Jun 26 10:06:15.346: INFO: Waiting for PV local-xd5cf to bind to PVC pvc-k2qb2 Jun 26 10:06:15.346: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-k2qb2] to have phase Bound Jun 26 10:06:15.391: INFO: PersistentVolumeClaim pvc-k2qb2 found but phase is Pending instead of Bound. Jun 26 10:06:17.500: INFO: PersistentVolumeClaim pvc-k2qb2 found but phase is Pending instead of Bound. Jun 26 10:06:19.623: INFO: PersistentVolumeClaim pvc-k2qb2 found but phase is Pending instead of Bound. Jun 26 10:06:21.671: INFO: PersistentVolumeClaim pvc-k2qb2 found and phase=Bound (6.32465304s) Jun 26 10:06:21.671: INFO: Waiting up to 3m0s for PersistentVolume local-xd5cf to have phase Bound Jun 26 10:06:21.705: INFO: PersistentVolume local-xd5cf found and phase=Bound (34.203621ms) �[1mSTEP�[0m: Creating pod pod-subpath-test-preprovisionedpv-47x4 �[1mSTEP�[0m: Creating a pod to test atomic-volume-subpath Jun 26 10:06:21.839: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-47x4" in namespace "provisioning-3835" to be "Succeeded or Failed" Jun 26 10:06:21.918: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Pending", Reason="", readiness=false. Elapsed: 78.406047ms Jun 26 10:06:23.955: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.11563291s Jun 26 10:06:26.053: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.213535402s Jun 26 10:06:27.961: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.121433031s Jun 26 10:06:29.956: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.116779855s Jun 26 10:06:31.956: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.116962223s Jun 26 10:06:33.968: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Pending", Reason="", readiness=false. Elapsed: 12.128540972s Jun 26 10:06:35.955: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Running", Reason="", readiness=true. Elapsed: 14.115842553s Jun 26 10:06:37.958: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Running", Reason="", readiness=true. Elapsed: 16.118560585s Jun 26 10:06:39.955: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Running", Reason="", readiness=true. Elapsed: 18.115518262s Jun 26 10:06:41.955: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Running", Reason="", readiness=true. Elapsed: 20.115699415s Jun 26 10:06:43.954: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Running", Reason="", readiness=true. Elapsed: 22.115113217s Jun 26 10:06:45.956: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Running", Reason="", readiness=true. Elapsed: 24.116837768s Jun 26 10:06:47.956: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Running", Reason="", readiness=false. Elapsed: 26.116855059s Jun 26 10:06:49.955: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 28.115645372s �[1mSTEP�[0m: Saw pod success Jun 26 10:06:49.955: INFO: Pod "pod-subpath-test-preprovisionedpv-47x4" satisfied condition "Succeeded or Failed" Jun 26 10:06:49.995: INFO: Trying to get logs from node bootstrap-e2e-minion-group-kv80 pod pod-subpath-test-preprovisionedpv-47x4 container test-container-subpath-preprovisionedpv-47x4: <nil> �[1mSTEP�[0m: delete the pod Jun 26 10:06:50.098: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-47x4 to disappear Jun 26 10:06:50.135: INFO: Pod pod-subpath-test-preprovisionedpv-47x4 no longer exists �[1mSTEP�[0m: Deleting pod pod-subpath-test-preprovisionedpv-47x4 Jun 26 10:06:50.135: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-47x4" in namespace "provisioning-3835" �[1mSTEP�[0m: Deleting pod Jun 26 10:06:50.172: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-47x4" in namespace "provisioning-3835" �[1mSTEP�[0m: Deleting pv and pvc Jun 26 10:06:50.212: INFO: Deleting PersistentVolumeClaim "pvc-k2qb2" Jun 26 10:06:50.249: INFO: Deleting PersistentVolume "local-xd5cf" �[1mSTEP�[0m: Removing the test directory Jun 26 10:06:50.285: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c umount /tmp/local-driver-9e778353-238c-4f66-89bf-8e9194d79349 && rm -r /tmp/local-driver-9e778353-238c-4f66-89bf-8e9194d79349] Namespace:provisioning-3835 PodName:hostexec-bootstrap-e2e-minion-group-kv80-ssdb5 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:50.285: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:50.286: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:50.286: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-3835/pods/hostexec-bootstrap-e2e-minion-group-kv80-ssdb5/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=umount+%2Ftmp%2Flocal-driver-9e778353-238c-4f66-89bf-8e9194d79349+%26%26+rm+-r+%2Ftmp%2Flocal-driver-9e778353-238c-4f66-89bf-8e9194d79349&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:07:20.401: INFO: exec bootstrap-e2e-minion-group-kv80: command: umount /tmp/local-driver-9e778353-238c-4f66-89bf-8e9194d79349 && rm -r /tmp/local-driver-9e778353-238c-4f66-89bf-8e9194d79349 Jun 26 10:07:20.402: INFO: exec bootstrap-e2e-minion-group-kv80: stdout: "" Jun 26 10:07:20.402: INFO: exec bootstrap-e2e-minion-group-kv80: stderr: "" Jun 26 10:07:20.402: INFO: exec bootstrap-e2e-minion-group-kv80: exit code: 0 Jun 26 10:07:20.402: INFO: Unexpected error: <*errors.StatusError | 0xc000e7d7c0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } Jun 26 10:07:20.402: FAIL: error dialing backend: dial timeout, backstop Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).cleanupLocalVolumeDirectoryBindMounted(0xc00279e570, 0xc00349f980) test/e2e/storage/utils/local.go:251 +0xf2 k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).Remove(0x22?, 0xc002e885b0?) test/e2e/storage/utils/local.go:345 +0x128 k8s.io/kubernetes/test/e2e/storage/drivers.(*localVolume).DeleteVolume(0xc002f30e90?) test/e2e/storage/drivers/in_tree.go:1952 +0x28 k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0x7ac14c8?) test/e2e/storage/utils/utils.go:714 +0x6d k8s.io/kubernetes/test/e2e/storage/framework.(*VolumeResource).CleanupResource(0xc002000840) test/e2e/storage/framework/volume_resource.go:231 +0xc6d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func2() test/e2e/storage/testsuites/subpath.go:179 +0x12d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func6() test/e2e/storage/testsuites/subpath.go:240 +0x1ed k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc00066b860, 0x746f348) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting pod hostexec-bootstrap-e2e-minion-group-kv80-ssdb5 in namespace provisioning-3835 [AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Collecting events from namespace "provisioning-3835". �[1mSTEP�[0m: Found 13 events. Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:08 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-ssdb5: {default-scheduler } Scheduled: Successfully assigned provisioning-3835/hostexec-bootstrap-e2e-minion-group-kv80-ssdb5 to bootstrap-e2e-minion-group-kv80 Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:10 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-ssdb5: {kubelet bootstrap-e2e-minion-group-kv80} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:10 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-ssdb5: {kubelet bootstrap-e2e-minion-group-kv80} Created: Created container agnhost-container Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:11 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-ssdb5: {kubelet bootstrap-e2e-minion-group-kv80} Started: Started container agnhost-container Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:15 +0000 UTC - event for pvc-k2qb2: {persistentvolume-controller } ProvisioningFailed: storageclass.storage.k8s.io "provisioning-3835" not found Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:21 +0000 UTC - event for pod-subpath-test-preprovisionedpv-47x4: {default-scheduler } Scheduled: Successfully assigned provisioning-3835/pod-subpath-test-preprovisionedpv-47x4 to bootstrap-e2e-minion-group-kv80 Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:25 +0000 UTC - event for pod-subpath-test-preprovisionedpv-47x4: {kubelet bootstrap-e2e-minion-group-kv80} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:25 +0000 UTC - event for pod-subpath-test-preprovisionedpv-47x4: {kubelet bootstrap-e2e-minion-group-kv80} Created: Created container init-volume-preprovisionedpv-47x4 Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:25 +0000 UTC - event for pod-subpath-test-preprovisionedpv-47x4: {kubelet bootstrap-e2e-minion-group-kv80} Started: Started container init-volume-preprovisionedpv-47x4 Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:26 +0000 UTC - event for pod-subpath-test-preprovisionedpv-47x4: {kubelet bootstrap-e2e-minion-group-kv80} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:26 +0000 UTC - event for pod-subpath-test-preprovisionedpv-47x4: {kubelet bootstrap-e2e-minion-group-kv80} Created: Created container test-container-subpath-preprovisionedpv-47x4 Jun 26 10:07:20.571: INFO: At 2022-06-26 10:06:26 +0000 UTC - event for pod-subpath-test-preprovisionedpv-47x4: {kubelet bootstrap-e2e-minion-group-kv80} Started: Started container test-container-subpath-preprovisionedpv-47x4 Jun 26 10:07:20.571: INFO: At 2022-06-26 10:07:20 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-ssdb5: {kubelet bootstrap-e2e-minion-group-kv80} Killing: Stopping container agnhost-container Jun 26 10:07:20.620: INFO: POD NODE PHASE GRACE CONDITIONS Jun 26 10:07:20.620: INFO: Jun 26 10:07:20.711: INFO: Logging node info for node bootstrap-e2e-master Jun 26 10:07:20.763: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 96f3154f-aacc-400a-ad66-d67f41c6b36b 9275 0 2022-06-26 10:01:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860045824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597901824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.168.138.173,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:948953d461317864b1fe4464d95c432a,SystemUUID:948953d4-6131-7864-b1fe-4464d95c432a,BootID:e5607f80-4a27-4601-af47-005a2514594d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:127703507,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:117521209,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:51075896,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:9870ed22905d03e3fa5cd2d57118784999fb581c49310f6cac0c3795bcdd7ee7 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.32],SizeBytes:17930113,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:20.764: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 26 10:07:20.830: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 26 10:07:20.913: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.913: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:20.913: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.913: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 26 10:07:20.913: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.913: INFO: Container kube-apiserver ready: true, restart count 0 Jun 26 10:07:20.913: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-26 10:00:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.913: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 26 10:07:20.913: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-26 10:00:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.913: INFO: Container l7-lb-controller ready: true, restart count 2 Jun 26 10:07:20.913: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.913: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:20.913: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.913: INFO: Container kube-scheduler ready: true, restart count 0 Jun 26 10:07:20.913: INFO: metadata-proxy-v0.1-79zmr started at 2022-06-26 10:01:13 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:20.913: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:20.913: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:20.913: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:20.913: INFO: Container kube-controller-manager ready: true, restart count 1 Jun 26 10:07:21.245: INFO: Latency metrics for node bootstrap-e2e-master Jun 26 10:07:21.245: INFO: Logging node info for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:21.306: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-kv80 8fe21414-4e64-490c-92b5-167dc1e64d0a 9403 0 2022-06-26 10:01:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-kv80 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-kv80 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:06:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:34 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-kv80,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.113.50,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b6c246299f5ddd34e63819759303fbd4,SystemUUID:b6c24629-9f5d-dd34-e638-19759303fbd4,BootID:b4e429f5-615d-4b99-b5eb-195153abb687,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:21.306: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:21.366: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:21.476: INFO: metadata-proxy-v0.1-glv9b started at 2022-06-26 10:01:12 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:21.476: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:21.476: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:21.476: INFO: coredns-85bc9d67b-2pcch started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:21.476: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:21.476: INFO: deployment-5cd6f9c8c9-pm2kh started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:21.476: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:21.476: INFO: l7-default-backend-5f6f9745f9-95c2d started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:21.476: INFO: Container default-http-backend ready: true, restart count 0 Jun 26 10:07:21.476: INFO: konnectivity-agent-gh7lr started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:21.476: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:21.476: INFO: deployment-6c468f5898-sqsr7 started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:21.476: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:21.476: INFO: volume-snapshot-controller-0 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:21.476: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 26 10:07:21.476: INFO: execpod-affinityt97jd started at 2022-06-26 10:06:40 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:21.476: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:21.476: INFO: affinity-nodeport-timeout-2259x started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:21.476: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:21.476: INFO: kube-proxy-bootstrap-e2e-minion-group-kv80 started at 2022-06-26 10:01:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:21.476: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:21.476: INFO: npd-v0.8.9-vsk67 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:21.476: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:21.476: INFO: pfpod started at 2022-06-26 10:06:51 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:21.476: INFO: Container portforwardtester ready: false, restart count 0 Jun 26 10:07:21.476: INFO: Container readiness ready: false, restart count 0 Jun 26 10:07:21.800: INFO: Latency metrics for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:21.800: INFO: Logging node info for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:21.874: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l6r5 bcf9cd6e-4842-45b7-9f21-7de490b4df8c 9626 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l6r5 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l6r5 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6165":"bootstrap-e2e-minion-group-l6r5","csi-mock-csi-mock-volumes-9260":"bootstrap-e2e-minion-group-l6r5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-06-26 10:01:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:07:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} }]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-l6r5,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-06-26 10:06:59 +0000 UTC,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoExecute,TimeAdded:2022-06-26 10:07:04 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:35.227.167.115,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5bb667ad496693fbfa6f2dcbfb63cab,SystemUUID:f5bb667a-d496-693f-bfa6-f2dcbfb63cab,BootID:730f0552-4b2a-4a66-b12d-5824a7e7a976,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858,DevicePath:,},},Config:nil,},} Jun 26 10:07:21.875: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:21.949: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:22.038: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l6r5: error trying to reach service: dial tcp 10.138.0.5:10250: connect: connection refused Jun 26 10:07:22.038: INFO: Logging node info for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:22.089: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-w1f4 aa1194c1-9599-41dd-8e29-c249fef7248e 9523 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-w1f4 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-w1f4 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:04:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-w1f4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.185.251.58,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38c15cfcea7d87fcfdfb495c46c9f2bd,SystemUUID:38c15cfc-ea7d-87fc-fdfb-495c46c9f2bd,BootID:f547655d-3f0b-4b8f-9e52-ac7560e71bb7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:22.089: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:22.182: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:22.281: INFO: rand-non-local-rcw7v started at 2022-06-26 10:06:45 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container c ready: false, restart count 0 Jun 26 10:07:22.281: INFO: hairpin started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:22.281: INFO: service-headless-rfn2p started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:22.281: INFO: affinity-nodeport-timeout-pf8ht started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:22.281: INFO: verify-service-up-host-exec-pod started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:22.281: INFO: kube-proxy-bootstrap-e2e-minion-group-w1f4 started at 2022-06-26 10:01:19 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:22.281: INFO: konnectivity-agent-8w8st started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:22.281: INFO: pod-projected-secrets-d0859f57-a6b7-4b81-be26-970fd1a684b4 started at 2022-06-26 10:05:58 +0000 UTC (0+3 container statuses recorded) Jun 26 10:07:22.281: INFO: Container creates-volume-test ready: true, restart count 0 Jun 26 10:07:22.281: INFO: Container dels-volume-test ready: true, restart count 0 Jun 26 10:07:22.281: INFO: Container upds-volume-test ready: true, restart count 0 Jun 26 10:07:22.281: INFO: deployment-5cd6f9c8c9-2s82l started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:22.281: INFO: rand-non-local-gxjbx started at 2022-06-26 10:07:01 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container c ready: false, restart count 0 Jun 26 10:07:22.281: INFO: kube-dns-autoscaler-5477bd659c-hwxn2 started at 2022-06-26 10:06:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container autoscaler ready: true, restart count 0 Jun 26 10:07:22.281: INFO: hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc started at 2022-06-26 10:06:27 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:22.281: INFO: service-headless-toggled-flcct started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:22.281: INFO: npd-v0.8.9-hzvbm started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:22.281: INFO: liveness-1ffb8679-e880-42c5-9594-e7ce6b90aafe started at 2022-06-26 10:04:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:22.281: INFO: test-grpc-0024d73f-6f4d-4e93-a689-31d246e3fd09 started at 2022-06-26 10:05:32 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.281: INFO: Container etcd ready: true, restart count 0 Jun 26 10:07:22.281: INFO: metadata-proxy-v0.1-lj6mb started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:22.281: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:22.281: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:22.282: INFO: rand-non-local-9thk7 started at 2022-06-26 10:06:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.282: INFO: Container c ready: false, restart count 0 Jun 26 10:07:22.557: INFO: Latency metrics for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:22.557: INFO: Logging node info for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:22.669: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-zvd6 465e1e7d-9f60-42b7-acea-e8cd1dca80e2 9527 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-zvd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-zvd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2385":"bootstrap-e2e-minion-group-zvd6","csi-hostpath-provisioning-6151":"bootstrap-e2e-minion-group-zvd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-26 10:06:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-zvd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.91.218,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aa6080e0da2673fad5141cc4863e32c,SystemUUID:4aa6080e-0da2-673f-ad51-41cc4863e32c,BootID:628a7f46-4bbe-40bc-aa89-4f2b41dd6222,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62,DevicePath:,},},Config:nil,},} Jun 26 10:07:22.670: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:22.749: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:22.977: INFO: private started at 2022-06-26 10:06:42 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:22.977: INFO: metadata-proxy-v0.1-hrd5b started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:22.977: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:22.977: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:06:28 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:22.977: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:22.977: INFO: verify-service-up-exec-pod-85m6b started at 2022-06-26 10:06:26 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:22.977: INFO: coredns-85bc9d67b-6grvl started at 2022-06-26 10:05:59 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:22.977: INFO: kube-proxy-bootstrap-e2e-minion-group-zvd6 started at 2022-06-26 10:01:20 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:22.977: INFO: npd-v0.8.9-w26wg started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:22.977: INFO: konnectivity-agent-thvrv started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:22.977: INFO: slave started at 2022-06-26 10:06:39 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:22.977: INFO: inline-volume-tester-nkqft started at 2022-06-26 10:05:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container csi-volume-tester ready: true, restart count 0 Jun 26 10:07:22.977: INFO: service-headless-toggled-27ccn started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:22.977: INFO: service-headless-lrtx9 started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:22.977: INFO: master started at 2022-06-26 10:06:35 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:22.977: INFO: adopt-release-brsdt started at 2022-06-26 10:06:21 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container c ready: false, restart count 0 Jun 26 10:07:22.977: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:05:43 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:22.977: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:22.977: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:22.977: INFO: default started at 2022-06-26 10:06:44 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:22.977: INFO: affinity-nodeport-timeout-4b548 started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:22.977: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:23.283: INFO: Latency metrics for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:23.283: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready Jun 26 10:07:23.358: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:25.475: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:27.479: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:29.489: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:31.487: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:33.475: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:35.501: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:37.473: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:39.476: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:41.493: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:43.480: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:45.493: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:47.476: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:49.477: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:51.483: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:53.477: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:55.475: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:57.486: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:59.475: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:08:01.474: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:03.460: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:05.504: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:07.464: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:09.472: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:11.495: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:13.566: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure �[1mSTEP�[0m: Destroying namespace "provisioning-3835" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\slocal\]\[LocalVolumeType\:\sdir\]\s\[Testpattern\:\sPre\-provisioned\sPV\s\(default\sfs\)\]\svolumes\sshould\sstore\sdata$'
test/e2e/storage/testsuites/volumes.go:161 Jun 26 10:06:59.800: error dialing backend: dial timeout, backstop test/e2e/storage/utils/local.go:211from junit_24.xml
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 26 10:05:36.751: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename volume �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should store data test/e2e/storage/testsuites/volumes.go:161 Jun 26 10:05:37.076: INFO: In-tree plugin kubernetes.io/local-volume is not migrated, not validating any metrics Jun 26 10:05:37.128: INFO: Waiting up to 5m0s for pod "hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k" in namespace "volume-4406" to be "running" Jun 26 10:05:37.175: INFO: Pod "hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k": Phase="Pending", Reason="", readiness=false. Elapsed: 46.784248ms Jun 26 10:05:39.218: INFO: Pod "hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k": Phase="Pending", Reason="", readiness=false. Elapsed: 2.090610172s Jun 26 10:05:41.222: INFO: Pod "hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k": Phase="Running", Reason="", readiness=true. Elapsed: 4.094608489s Jun 26 10:05:41.223: INFO: Pod "hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k" satisfied condition "running" Jun 26 10:05:41.223: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-driver-5e06ebc5-9219-4f38-99e9-da3f00e19d7e] Namespace:volume-4406 PodName:hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:05:41.223: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:05:41.223: INFO: ExecWithOptions: Clientset creation Jun 26 10:05:41.224: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/volume-4406/pods/hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-driver-5e06ebc5-9219-4f38-99e9-da3f00e19d7e&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:05:41.530: INFO: Creating resource for pre-provisioned PV Jun 26 10:05:41.530: INFO: Creating PVC and PV �[1mSTEP�[0m: Creating a PVC followed by a PV Jun 26 10:05:41.613: INFO: Waiting for PV local-l6n9m to bind to PVC pvc-fkh9g Jun 26 10:05:41.613: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-fkh9g] to have phase Bound Jun 26 10:05:41.653: INFO: PersistentVolumeClaim pvc-fkh9g found but phase is Pending instead of Bound. Jun 26 10:05:43.690: INFO: PersistentVolumeClaim pvc-fkh9g found but phase is Pending instead of Bound. Jun 26 10:05:45.728: INFO: PersistentVolumeClaim pvc-fkh9g found but phase is Pending instead of Bound. Jun 26 10:05:47.782: INFO: PersistentVolumeClaim pvc-fkh9g found but phase is Pending instead of Bound. Jun 26 10:05:49.825: INFO: PersistentVolumeClaim pvc-fkh9g found and phase=Bound (8.211624711s) Jun 26 10:05:49.825: INFO: Waiting up to 3m0s for PersistentVolume local-l6n9m to have phase Bound Jun 26 10:05:49.860: INFO: PersistentVolume local-l6n9m found and phase=Bound (35.175087ms) �[1mSTEP�[0m: starting local-injector Jun 26 10:05:49.974: INFO: Waiting up to 5m0s for pod "local-injector" in namespace "volume-4406" to be "running" Jun 26 10:05:50.010: INFO: Pod "local-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 36.053011ms Jun 26 10:05:52.045: INFO: Pod "local-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.070950728s Jun 26 10:05:54.053: INFO: Pod "local-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.07861782s Jun 26 10:05:56.058: INFO: Pod "local-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.083205784s Jun 26 10:05:58.051: INFO: Pod "local-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.076713066s Jun 26 10:06:00.049: INFO: Pod "local-injector": Phase="Running", Reason="", readiness=true. Elapsed: 10.074443865s Jun 26 10:06:00.049: INFO: Pod "local-injector" satisfied condition "running" �[1mSTEP�[0m: Writing text file contents in the container. Jun 26 10:06:00.049: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.168.138.173 --kubeconfig=/workspace/.kube/config --namespace=volume-4406 exec local-injector --namespace=volume-4406 -- /bin/sh -c echo 'Hello from local from namespace volume-4406' > /opt/0/index.html' Jun 26 10:06:00.591: INFO: stderr: "" Jun 26 10:06:00.591: INFO: stdout: "" �[1mSTEP�[0m: Checking that text file contents are perfect. Jun 26 10:06:00.591: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.168.138.173 --kubeconfig=/workspace/.kube/config --namespace=volume-4406 exec local-injector --namespace=volume-4406 -- cat /opt/0/index.html' Jun 26 10:06:01.181: INFO: stderr: "" Jun 26 10:06:01.181: INFO: stdout: "Hello from local from namespace volume-4406\n" Jun 26 10:06:01.181: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:volume-4406 PodName:local-injector ContainerName:local-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:01.181: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:01.182: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:01.182: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/volume-4406/pods/local-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=local-injector&container=local-injector&stderr=true&stdout=true) Jun 26 10:06:01.546: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:volume-4406 PodName:local-injector ContainerName:local-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:01.547: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:01.548: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:01.548: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/volume-4406/pods/local-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=local-injector&container=local-injector&stderr=true&stdout=true) �[1mSTEP�[0m: Deleting pod local-injector in namespace volume-4406 Jun 26 10:06:01.994: INFO: Waiting for pod local-injector to disappear Jun 26 10:06:02.040: INFO: Pod local-injector still exists Jun 26 10:06:04.040: INFO: Waiting for pod local-injector to disappear Jun 26 10:06:04.082: INFO: Pod local-injector still exists Jun 26 10:06:06.042: INFO: Waiting for pod local-injector to disappear Jun 26 10:06:06.145: INFO: Pod local-injector no longer exists �[1mSTEP�[0m: starting local-client Jun 26 10:06:06.223: INFO: Waiting up to 5m0s for pod "local-client" in namespace "volume-4406" to be "running" Jun 26 10:06:06.267: INFO: Pod "local-client": Phase="Pending", Reason="", readiness=false. Elapsed: 44.092684ms Jun 26 10:06:08.438: INFO: Pod "local-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2.215089125s Jun 26 10:06:10.322: INFO: Pod "local-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4.099356786s Jun 26 10:06:12.307: INFO: Pod "local-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6.084342625s Jun 26 10:06:14.304: INFO: Pod "local-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8.081379947s Jun 26 10:06:16.305: INFO: Pod "local-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10.082511351s Jun 26 10:06:18.318: INFO: Pod "local-client": Phase="Running", Reason="", readiness=true. Elapsed: 12.095249819s Jun 26 10:06:18.318: INFO: Pod "local-client" satisfied condition "running" �[1mSTEP�[0m: Checking that text file contents are perfect. Jun 26 10:06:18.318: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.168.138.173 --kubeconfig=/workspace/.kube/config --namespace=volume-4406 exec local-client --namespace=volume-4406 -- cat /opt/0/index.html' Jun 26 10:06:18.927: INFO: stderr: "" Jun 26 10:06:18.927: INFO: stdout: "Hello from local from namespace volume-4406\n" Jun 26 10:06:18.927: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:volume-4406 PodName:local-client ContainerName:local-client Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:18.927: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:18.928: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:18.928: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/volume-4406/pods/local-client/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=local-client&container=local-client&stderr=true&stdout=true) Jun 26 10:06:19.569: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:volume-4406 PodName:local-client ContainerName:local-client Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:19.569: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:19.570: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:19.570: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/volume-4406/pods/local-client/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=local-client&container=local-client&stderr=true&stdout=true) �[1mSTEP�[0m: Repeating the test on an ephemeral container (if enabled) Jun 26 10:06:20.177: INFO: Waiting up to 5m0s for pod "local-client" in namespace "volume-4406" to be "container volume-ephemeral-container running" Jun 26 10:06:20.250: INFO: Pod "local-client": Phase="Running", Reason="", readiness=true. Elapsed: 73.106421ms Jun 26 10:06:22.290: INFO: Pod "local-client": Phase="Running", Reason="", readiness=true. Elapsed: 2.112410888s Jun 26 10:06:24.288: INFO: Pod "local-client": Phase="Running", Reason="", readiness=true. Elapsed: 4.110345933s Jun 26 10:06:24.288: INFO: Pod "local-client" satisfied condition "container volume-ephemeral-container running" �[1mSTEP�[0m: Checking that text file contents are perfect. Jun 26 10:06:24.288: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.168.138.173 --kubeconfig=/workspace/.kube/config --namespace=volume-4406 exec local-client --namespace=volume-4406 --container=volume-ephemeral-container -- cat /opt/0/index.html' Jun 26 10:06:24.804: INFO: stderr: "" Jun 26 10:06:24.804: INFO: stdout: "Hello from local from namespace volume-4406\n" Jun 26 10:06:24.804: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:volume-4406 PodName:local-client ContainerName:local-client Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:24.804: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:24.806: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:24.806: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/volume-4406/pods/local-client/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=local-client&container=local-client&stderr=true&stdout=true) Jun 26 10:06:25.099: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:volume-4406 PodName:local-client ContainerName:local-client Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:25.099: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:25.101: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:25.101: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/volume-4406/pods/local-client/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=local-client&container=local-client&stderr=true&stdout=true) �[1mSTEP�[0m: Deleting pod local-client in namespace volume-4406 Jun 26 10:06:25.537: INFO: Waiting for pod local-client to disappear Jun 26 10:06:25.573: INFO: Pod local-client still exists Jun 26 10:06:27.574: INFO: Waiting for pod local-client to disappear Jun 26 10:06:27.628: INFO: Pod local-client still exists Jun 26 10:06:29.574: INFO: Waiting for pod local-client to disappear Jun 26 10:06:29.611: INFO: Pod local-client no longer exists �[1mSTEP�[0m: cleaning the environment after local �[1mSTEP�[0m: Deleting pv and pvc Jun 26 10:06:29.611: INFO: Deleting PersistentVolumeClaim "pvc-fkh9g" Jun 26 10:06:29.652: INFO: Deleting PersistentVolume "local-l6n9m" �[1mSTEP�[0m: Removing the test directory Jun 26 10:06:29.689: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-driver-5e06ebc5-9219-4f38-99e9-da3f00e19d7e] Namespace:volume-4406 PodName:hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:29.689: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:29.690: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:29.691: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/volume-4406/pods/hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-driver-5e06ebc5-9219-4f38-99e9-da3f00e19d7e&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:06:59.799: INFO: exec bootstrap-e2e-minion-group-zvd6: command: rm -r /tmp/local-driver-5e06ebc5-9219-4f38-99e9-da3f00e19d7e Jun 26 10:06:59.799: INFO: exec bootstrap-e2e-minion-group-zvd6: stdout: "" Jun 26 10:06:59.799: INFO: exec bootstrap-e2e-minion-group-zvd6: stderr: "" Jun 26 10:06:59.799: INFO: exec bootstrap-e2e-minion-group-zvd6: exit code: 0 Jun 26 10:06:59.799: INFO: Unexpected error: <*errors.StatusError | 0xc0009934a0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } Jun 26 10:06:59.800: FAIL: error dialing backend: dial timeout, backstop Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).cleanupLocalVolumeDirectory(0xc00292a090, 0xc003614c80) test/e2e/storage/utils/local.go:211 +0xc5 k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).Remove(0x22?, 0xc0022d20d0?) test/e2e/storage/utils/local.go:341 +0x4b k8s.io/kubernetes/test/e2e/storage/drivers.(*localVolume).DeleteVolume(0xc003b90970?) test/e2e/storage/drivers/in_tree.go:1952 +0x28 k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0x7ac14c8?) test/e2e/storage/utils/utils.go:714 +0x6d k8s.io/kubernetes/test/e2e/storage/framework.(*VolumeResource).CleanupResource(0xc001b40000) test/e2e/storage/framework/volume_resource.go:231 +0xc6d k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func2() test/e2e/storage/testsuites/volumes.go:151 +0x4b k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3.1() test/e2e/storage/testsuites/volumes.go:165 +0x165 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3() test/e2e/storage/testsuites/volumes.go:194 +0x554 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000ea0000?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000ebe4e0, 0x746f348) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting pod hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k in namespace volume-4406 [AfterEach] [Testpattern: Pre-provisioned PV (default fs)] volumes test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Collecting events from namespace "volume-4406". �[1mSTEP�[0m: Found 20 events. Jun 26 10:07:00.134: INFO: At 2022-06-26 10:05:37 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k: {default-scheduler } Scheduled: Successfully assigned volume-4406/hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k to bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:00.134: INFO: At 2022-06-26 10:05:38 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k: {kubelet bootstrap-e2e-minion-group-zvd6} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:07:00.134: INFO: At 2022-06-26 10:05:38 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k: {kubelet bootstrap-e2e-minion-group-zvd6} Created: Created container agnhost-container Jun 26 10:07:00.134: INFO: At 2022-06-26 10:05:38 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k: {kubelet bootstrap-e2e-minion-group-zvd6} Started: Started container agnhost-container Jun 26 10:07:00.134: INFO: At 2022-06-26 10:05:41 +0000 UTC - event for pvc-fkh9g: {persistentvolume-controller } ProvisioningFailed: storageclass.storage.k8s.io "volume-4406" not found Jun 26 10:07:00.134: INFO: At 2022-06-26 10:05:49 +0000 UTC - event for local-injector: {default-scheduler } Scheduled: Successfully assigned volume-4406/local-injector to bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:00.134: INFO: At 2022-06-26 10:05:53 +0000 UTC - event for local-injector: {kubelet bootstrap-e2e-minion-group-zvd6} Started: Started container local-injector Jun 26 10:07:00.134: INFO: At 2022-06-26 10:05:53 +0000 UTC - event for local-injector: {kubelet bootstrap-e2e-minion-group-zvd6} Created: Created container local-injector Jun 26 10:07:00.134: INFO: At 2022-06-26 10:05:53 +0000 UTC - event for local-injector: {kubelet bootstrap-e2e-minion-group-zvd6} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 26 10:07:00.134: INFO: At 2022-06-26 10:06:01 +0000 UTC - event for local-injector: {kubelet bootstrap-e2e-minion-group-zvd6} Killing: Stopping container local-injector Jun 26 10:07:00.134: INFO: At 2022-06-26 10:06:06 +0000 UTC - event for local-client: {default-scheduler } Scheduled: Successfully assigned volume-4406/local-client to bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:00.134: INFO: At 2022-06-26 10:06:10 +0000 UTC - event for local-client: {kubelet bootstrap-e2e-minion-group-zvd6} Started: Started container local-client Jun 26 10:07:00.134: INFO: At 2022-06-26 10:06:10 +0000 UTC - event for local-client: {kubelet bootstrap-e2e-minion-group-zvd6} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 26 10:07:00.134: INFO: At 2022-06-26 10:06:10 +0000 UTC - event for local-client: {kubelet bootstrap-e2e-minion-group-zvd6} Created: Created container local-client Jun 26 10:07:00.134: INFO: At 2022-06-26 10:06:20 +0000 UTC - event for local-client: {kubelet bootstrap-e2e-minion-group-zvd6} Created: Created container volume-ephemeral-container Jun 26 10:07:00.134: INFO: At 2022-06-26 10:06:20 +0000 UTC - event for local-client: {kubelet bootstrap-e2e-minion-group-zvd6} Started: Started container volume-ephemeral-container Jun 26 10:07:00.134: INFO: At 2022-06-26 10:06:20 +0000 UTC - event for local-client: {kubelet bootstrap-e2e-minion-group-zvd6} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 26 10:07:00.134: INFO: At 2022-06-26 10:06:25 +0000 UTC - event for local-client: {kubelet bootstrap-e2e-minion-group-zvd6} Killing: Stopping container local-client Jun 26 10:07:00.134: INFO: At 2022-06-26 10:06:25 +0000 UTC - event for local-client: {kubelet bootstrap-e2e-minion-group-zvd6} Killing: Stopping container volume-ephemeral-container Jun 26 10:07:00.134: INFO: At 2022-06-26 10:06:59 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k: {kubelet bootstrap-e2e-minion-group-zvd6} Killing: Stopping container agnhost-container Jun 26 10:07:00.180: INFO: POD NODE PHASE GRACE CONDITIONS Jun 26 10:07:00.180: INFO: Jun 26 10:07:00.267: INFO: Logging node info for node bootstrap-e2e-master Jun 26 10:07:00.323: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 96f3154f-aacc-400a-ad66-d67f41c6b36b 9275 0 2022-06-26 10:01:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860045824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597901824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.168.138.173,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:948953d461317864b1fe4464d95c432a,SystemUUID:948953d4-6131-7864-b1fe-4464d95c432a,BootID:e5607f80-4a27-4601-af47-005a2514594d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:127703507,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:117521209,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:51075896,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:9870ed22905d03e3fa5cd2d57118784999fb581c49310f6cac0c3795bcdd7ee7 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.32],SizeBytes:17930113,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:00.323: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 26 10:07:00.396: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 26 10:07:00.491: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:00.491: INFO: Container kube-controller-manager ready: true, restart count 1 Jun 26 10:07:00.491: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:00.491: INFO: Container kube-scheduler ready: true, restart count 0 Jun 26 10:07:00.491: INFO: metadata-proxy-v0.1-79zmr started at 2022-06-26 10:01:13 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:00.491: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:00.491: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:00.491: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-26 10:00:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:00.491: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 26 10:07:00.491: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-26 10:00:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:00.491: INFO: Container l7-lb-controller ready: true, restart count 2 Jun 26 10:07:00.491: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:00.491: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:00.491: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:00.491: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:00.491: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:00.491: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 26 10:07:00.491: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:00.491: INFO: Container kube-apiserver ready: true, restart count 0 Jun 26 10:07:00.813: INFO: Latency metrics for node bootstrap-e2e-master Jun 26 10:07:00.813: INFO: Logging node info for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:00.859: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-kv80 8fe21414-4e64-490c-92b5-167dc1e64d0a 9403 0 2022-06-26 10:01:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-kv80 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-kv80 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:06:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:34 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-kv80,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.113.50,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b6c246299f5ddd34e63819759303fbd4,SystemUUID:b6c24629-9f5d-dd34-e638-19759303fbd4,BootID:b4e429f5-615d-4b99-b5eb-195153abb687,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:00.859: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:00.944: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:01.065: INFO: hostexec-bootstrap-e2e-minion-group-kv80-ssdb5 started at 2022-06-26 10:06:08 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:01.065: INFO: affinity-nodeport-timeout-2259x started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:01.065: INFO: kube-proxy-bootstrap-e2e-minion-group-kv80 started at 2022-06-26 10:01:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:01.065: INFO: npd-v0.8.9-vsk67 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:01.065: INFO: hostexec-bootstrap-e2e-minion-group-kv80-qv6bg started at 2022-06-26 10:06:04 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:01.065: INFO: dns-test-3c2cd7d3-edb0-4970-a414-32648a9f811e started at 2022-06-26 10:06:43 +0000 UTC (0+3 container statuses recorded) Jun 26 10:07:01.065: INFO: Container jessie-querier ready: true, restart count 0 Jun 26 10:07:01.065: INFO: Container querier ready: true, restart count 0 Jun 26 10:07:01.065: INFO: Container webserver ready: true, restart count 0 Jun 26 10:07:01.065: INFO: pfpod started at 2022-06-26 10:06:51 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:01.065: INFO: Container portforwardtester ready: true, restart count 0 Jun 26 10:07:01.065: INFO: Container readiness ready: true, restart count 0 Jun 26 10:07:01.065: INFO: hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 started at 2022-06-26 10:06:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:01.065: INFO: deployment-5cd6f9c8c9-pm2kh started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:01.065: INFO: metadata-proxy-v0.1-glv9b started at 2022-06-26 10:01:12 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:01.065: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:01.065: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:01.065: INFO: coredns-85bc9d67b-2pcch started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:01.065: INFO: deployment-6c468f5898-sqsr7 started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:01.065: INFO: replace-27603965-4krdm started at 2022-06-26 10:05:00 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container c ready: false, restart count 0 Jun 26 10:07:01.065: INFO: l7-default-backend-5f6f9745f9-95c2d started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container default-http-backend ready: true, restart count 0 Jun 26 10:07:01.065: INFO: konnectivity-agent-gh7lr started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:01.065: INFO: volume-snapshot-controller-0 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 26 10:07:01.065: INFO: execpod-affinityt97jd started at 2022-06-26 10:06:40 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:01.065: INFO: test-rs-zw7jg started at 2022-06-26 10:06:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container httpd ready: true, restart count 0 Jun 26 10:07:01.065: INFO: hostexec-bootstrap-e2e-minion-group-kv80-mvclh started at 2022-06-26 10:06:57 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.065: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:01.372: INFO: Latency metrics for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:01.372: INFO: Logging node info for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:01.424: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l6r5 bcf9cd6e-4842-45b7-9f21-7de490b4df8c 9553 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l6r5 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l6r5 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6165":"bootstrap-e2e-minion-group-l6r5","csi-mock-csi-mock-volumes-9260":"bootstrap-e2e-minion-group-l6r5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-06-26 10:01:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} }]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-l6r5,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-06-26 10:06:59 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:35.227.167.115,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5bb667ad496693fbfa6f2dcbfb63cab,SystemUUID:f5bb667a-d496-693f-bfa6-f2dcbfb63cab,BootID:730f0552-4b2a-4a66-b12d-5824a7e7a976,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858,DevicePath:,},},Config:nil,},} Jun 26 10:07:01.425: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:01.478: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:01.556: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l6r5: error trying to reach service: dial tcp 10.138.0.5:10250: connect: connection refused Jun 26 10:07:01.556: INFO: Logging node info for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:01.604: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-w1f4 aa1194c1-9599-41dd-8e29-c249fef7248e 9523 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-w1f4 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-w1f4 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:04:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-w1f4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.185.251.58,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38c15cfcea7d87fcfdfb495c46c9f2bd,SystemUUID:38c15cfc-ea7d-87fc-fdfb-495c46c9f2bd,BootID:f547655d-3f0b-4b8f-9e52-ac7560e71bb7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:01.605: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:01.668: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:01.749: INFO: metadata-proxy-v0.1-lj6mb started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:01.749: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:01.749: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:01.749: INFO: rand-non-local-9thk7 started at 2022-06-26 10:06:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container c ready: false, restart count 0 Jun 26 10:07:01.749: INFO: adopt-release-stg6s started at 2022-06-26 10:06:09 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container c ready: true, restart count 0 Jun 26 10:07:01.749: INFO: adopt-release-s5pmp started at 2022-06-26 10:06:09 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container c ready: true, restart count 0 Jun 26 10:07:01.749: INFO: test-grpc-0024d73f-6f4d-4e93-a689-31d246e3fd09 started at 2022-06-26 10:05:32 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container etcd ready: true, restart count 0 Jun 26 10:07:01.749: INFO: hairpin started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:01.749: INFO: rand-non-local-rcw7v started at 2022-06-26 10:06:45 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container c ready: false, restart count 0 Jun 26 10:07:01.749: INFO: kube-proxy-bootstrap-e2e-minion-group-w1f4 started at 2022-06-26 10:01:19 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:01.749: INFO: konnectivity-agent-8w8st started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:01.749: INFO: service-headless-rfn2p started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:01.749: INFO: affinity-nodeport-timeout-pf8ht started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:01.749: INFO: verify-service-up-host-exec-pod started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:01.749: INFO: pod-projected-secrets-d0859f57-a6b7-4b81-be26-970fd1a684b4 started at 2022-06-26 10:05:58 +0000 UTC (0+3 container statuses recorded) Jun 26 10:07:01.749: INFO: Container creates-volume-test ready: true, restart count 0 Jun 26 10:07:01.749: INFO: Container dels-volume-test ready: true, restart count 0 Jun 26 10:07:01.749: INFO: Container upds-volume-test ready: true, restart count 0 Jun 26 10:07:01.749: INFO: deployment-5cd6f9c8c9-2s82l started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:01.749: INFO: npd-v0.8.9-hzvbm started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:01.749: INFO: liveness-1ffb8679-e880-42c5-9594-e7ce6b90aafe started at 2022-06-26 10:04:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:01.749: INFO: rand-non-local-gxjbx started at <nil> (0+0 container statuses recorded) Jun 26 10:07:01.749: INFO: kube-dns-autoscaler-5477bd659c-hwxn2 started at 2022-06-26 10:06:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container autoscaler ready: true, restart count 0 Jun 26 10:07:01.749: INFO: hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc started at 2022-06-26 10:06:27 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:01.749: INFO: service-headless-toggled-flcct started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:01.749: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:02.047: INFO: Latency metrics for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:02.047: INFO: Logging node info for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:02.120: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-zvd6 465e1e7d-9f60-42b7-acea-e8cd1dca80e2 9527 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-zvd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-zvd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2385":"bootstrap-e2e-minion-group-zvd6","csi-hostpath-provisioning-6151":"bootstrap-e2e-minion-group-zvd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-26 10:06:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-zvd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.91.218,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aa6080e0da2673fad5141cc4863e32c,SystemUUID:4aa6080e-0da2-673f-ad51-41cc4863e32c,BootID:628a7f46-4bbe-40bc-aa89-4f2b41dd6222,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62,DevicePath:,},},Config:nil,},} Jun 26 10:07:02.120: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:02.163: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:02.257: INFO: affinity-nodeport-timeout-4b548 started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:02.257: INFO: default started at 2022-06-26 10:06:44 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:02.257: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:06:28 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:02.257: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:02.257: INFO: verify-service-up-exec-pod-85m6b started at 2022-06-26 10:06:26 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:02.257: INFO: coredns-85bc9d67b-6grvl started at 2022-06-26 10:05:59 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:02.257: INFO: private started at 2022-06-26 10:06:42 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:02.257: INFO: metadata-proxy-v0.1-hrd5b started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:02.257: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:02.257: INFO: npd-v0.8.9-w26wg started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:02.257: INFO: konnectivity-agent-thvrv started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:02.257: INFO: kube-proxy-bootstrap-e2e-minion-group-zvd6 started at 2022-06-26 10:01:20 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:02.257: INFO: service-headless-lrtx9 started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:02.257: INFO: master started at 2022-06-26 10:06:35 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:02.257: INFO: adopt-release-brsdt started at 2022-06-26 10:06:21 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container c ready: false, restart count 0 Jun 26 10:07:02.257: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:05:43 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:02.257: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:02.257: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:02.257: INFO: slave started at 2022-06-26 10:06:39 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:02.257: INFO: inline-volume-tester-nkqft started at 2022-06-26 10:05:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.257: INFO: Container csi-volume-tester ready: true, restart count 0 Jun 26 10:07:02.258: INFO: service-headless-toggled-27ccn started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:02.258: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:02.560: INFO: Latency metrics for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:02.560: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready Jun 26 10:07:02.629: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jun 26 10:07:04.746: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jun 26 10:07:06.754: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:08.732: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:10.763: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:12.734: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:14.747: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:16.777: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:18.787: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:20.745: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:22.760: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:24.767: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:26.748: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:28.759: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:30.774: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:32.790: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:34.768: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:36.757: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:38.763: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:40.744: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:42.744: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:44.741: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:46.749: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:48.747: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:50.772: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:52.747: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:54.755: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:56.785: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:58.771: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:08:00.768: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:08:02.744: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:04.752: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:06.732: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:08.733: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:10.737: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:12.738: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:14.735: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure �[1mSTEP�[0m: Destroying namespace "volume-4406" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\slocal\]\[LocalVolumeType\:\stmpfs\]\s\[Testpattern\:\sPre\-provisioned\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sreadOnly\sfile\sspecified\sin\sthe\svolumeMount\s\[LinuxOnly\]$'
test/e2e/storage/testsuites/subpath.go:382 Jun 26 10:07:05.523: error dialing backend: dial timeout, backstop test/e2e/storage/utils/local.go:119from junit_06.xml
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 26 10:06:04.477: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should support readOnly file specified in the volumeMount [LinuxOnly] test/e2e/storage/testsuites/subpath.go:382 Jun 26 10:06:04.791: INFO: In-tree plugin kubernetes.io/local-volume is not migrated, not validating any metrics �[1mSTEP�[0m: Creating tmpfs mount point on node "bootstrap-e2e-minion-group-kv80" at path "/tmp/local-driver-e93a000d-c373-4c97-86da-daaf3fd8f880" Jun 26 10:06:04.866: INFO: Waiting up to 5m0s for pod "hostexec-bootstrap-e2e-minion-group-kv80-qv6bg" in namespace "provisioning-2498" to be "running" Jun 26 10:06:04.908: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-qv6bg": Phase="Pending", Reason="", readiness=false. Elapsed: 42.282012ms Jun 26 10:06:06.958: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-qv6bg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.091918339s Jun 26 10:06:09.044: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-qv6bg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.177622453s Jun 26 10:06:10.946: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-qv6bg": Phase="Pending", Reason="", readiness=false. Elapsed: 6.079460925s Jun 26 10:06:12.952: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-qv6bg": Phase="Pending", Reason="", readiness=false. Elapsed: 8.086407936s Jun 26 10:06:14.951: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-qv6bg": Phase="Running", Reason="", readiness=true. Elapsed: 10.084723542s Jun 26 10:06:14.951: INFO: Pod "hostexec-bootstrap-e2e-minion-group-kv80-qv6bg" satisfied condition "running" Jun 26 10:06:14.951: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p "/tmp/local-driver-e93a000d-c373-4c97-86da-daaf3fd8f880" && mount -t tmpfs -o size=10m tmpfs-"/tmp/local-driver-e93a000d-c373-4c97-86da-daaf3fd8f880" "/tmp/local-driver-e93a000d-c373-4c97-86da-daaf3fd8f880"] Namespace:provisioning-2498 PodName:hostexec-bootstrap-e2e-minion-group-kv80-qv6bg ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:14.951: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:14.952: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:14.952: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-2498/pods/hostexec-bootstrap-e2e-minion-group-kv80-qv6bg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%22%2Ftmp%2Flocal-driver-e93a000d-c373-4c97-86da-daaf3fd8f880%22+%26%26+mount+-t+tmpfs+-o+size%3D10m+tmpfs-%22%2Ftmp%2Flocal-driver-e93a000d-c373-4c97-86da-daaf3fd8f880%22+%22%2Ftmp%2Flocal-driver-e93a000d-c373-4c97-86da-daaf3fd8f880%22&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:06:15.313: INFO: Creating resource for pre-provisioned PV Jun 26 10:06:15.314: INFO: Creating PVC and PV �[1mSTEP�[0m: Creating a PVC followed by a PV Jun 26 10:06:15.397: INFO: Waiting for PV local-lnjcr to bind to PVC pvc-ttzb9 Jun 26 10:06:15.397: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-ttzb9] to have phase Bound Jun 26 10:06:15.438: INFO: PersistentVolumeClaim pvc-ttzb9 found but phase is Pending instead of Bound. Jun 26 10:06:17.526: INFO: PersistentVolumeClaim pvc-ttzb9 found but phase is Pending instead of Bound. Jun 26 10:06:19.632: INFO: PersistentVolumeClaim pvc-ttzb9 found and phase=Bound (4.23490405s) Jun 26 10:06:19.632: INFO: Waiting up to 3m0s for PersistentVolume local-lnjcr to have phase Bound Jun 26 10:06:19.712: INFO: PersistentVolume local-lnjcr found and phase=Bound (79.554888ms) �[1mSTEP�[0m: Creating pod pod-subpath-test-preprovisionedpv-qwnj �[1mSTEP�[0m: Creating a pod to test subpath Jun 26 10:06:19.966: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-qwnj" in namespace "provisioning-2498" to be "Succeeded or Failed" Jun 26 10:06:20.035: INFO: Pod "pod-subpath-test-preprovisionedpv-qwnj": Phase="Pending", Reason="", readiness=false. Elapsed: 69.109666ms Jun 26 10:06:22.080: INFO: Pod "pod-subpath-test-preprovisionedpv-qwnj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.114409904s Jun 26 10:06:24.072: INFO: Pod "pod-subpath-test-preprovisionedpv-qwnj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.106163365s Jun 26 10:06:26.109: INFO: Pod "pod-subpath-test-preprovisionedpv-qwnj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.143813107s Jun 26 10:06:28.079: INFO: Pod "pod-subpath-test-preprovisionedpv-qwnj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.113541462s Jun 26 10:06:30.071: INFO: Pod "pod-subpath-test-preprovisionedpv-qwnj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.105615867s Jun 26 10:06:32.072: INFO: Pod "pod-subpath-test-preprovisionedpv-qwnj": Phase="Pending", Reason="", readiness=false. Elapsed: 12.106536914s Jun 26 10:06:34.076: INFO: Pod "pod-subpath-test-preprovisionedpv-qwnj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.110198206s �[1mSTEP�[0m: Saw pod success Jun 26 10:06:34.076: INFO: Pod "pod-subpath-test-preprovisionedpv-qwnj" satisfied condition "Succeeded or Failed" Jun 26 10:06:34.112: INFO: Trying to get logs from node bootstrap-e2e-minion-group-kv80 pod pod-subpath-test-preprovisionedpv-qwnj container test-container-subpath-preprovisionedpv-qwnj: <nil> �[1mSTEP�[0m: delete the pod Jun 26 10:06:34.430: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-qwnj to disappear Jun 26 10:06:34.475: INFO: Pod pod-subpath-test-preprovisionedpv-qwnj no longer exists �[1mSTEP�[0m: Deleting pod pod-subpath-test-preprovisionedpv-qwnj Jun 26 10:06:34.475: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-qwnj" in namespace "provisioning-2498" �[1mSTEP�[0m: Deleting pod Jun 26 10:06:34.519: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-qwnj" in namespace "provisioning-2498" �[1mSTEP�[0m: Deleting pv and pvc Jun 26 10:06:34.563: INFO: Deleting PersistentVolumeClaim "pvc-ttzb9" Jun 26 10:06:34.637: INFO: Deleting PersistentVolume "local-lnjcr" �[1mSTEP�[0m: Unmount tmpfs mount point on node "bootstrap-e2e-minion-group-kv80" at path "/tmp/local-driver-e93a000d-c373-4c97-86da-daaf3fd8f880" Jun 26 10:06:34.696: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c umount "/tmp/local-driver-e93a000d-c373-4c97-86da-daaf3fd8f880"] Namespace:provisioning-2498 PodName:hostexec-bootstrap-e2e-minion-group-kv80-qv6bg ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:34.696: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:34.697: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:34.697: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-2498/pods/hostexec-bootstrap-e2e-minion-group-kv80-qv6bg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=umount+%22%2Ftmp%2Flocal-driver-e93a000d-c373-4c97-86da-daaf3fd8f880%22&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) �[1mSTEP�[0m: Removing the test directory Jun 26 10:06:35.348: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-driver-e93a000d-c373-4c97-86da-daaf3fd8f880] Namespace:provisioning-2498 PodName:hostexec-bootstrap-e2e-minion-group-kv80-qv6bg ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:35.348: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:35.349: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:35.350: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/provisioning-2498/pods/hostexec-bootstrap-e2e-minion-group-kv80-qv6bg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-driver-e93a000d-c373-4c97-86da-daaf3fd8f880&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:07:05.523: INFO: exec bootstrap-e2e-minion-group-kv80: command: rm -r /tmp/local-driver-e93a000d-c373-4c97-86da-daaf3fd8f880 Jun 26 10:07:05.523: INFO: exec bootstrap-e2e-minion-group-kv80: stdout: "" Jun 26 10:07:05.523: INFO: exec bootstrap-e2e-minion-group-kv80: stderr: "" Jun 26 10:07:05.523: INFO: exec bootstrap-e2e-minion-group-kv80: exit code: 0 Jun 26 10:07:05.523: INFO: Unexpected error: <*errors.StatusError | 0xc0008dbea0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } Jun 26 10:07:05.523: FAIL: error dialing backend: dial timeout, backstop Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).cleanupLocalVolumeTmpfs(0xc00320ad80, 0xc000a99740) test/e2e/storage/utils/local.go:119 +0x1d7 k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).Remove(0x22?, 0xc0035e2d00?) test/e2e/storage/utils/local.go:349 +0x8b k8s.io/kubernetes/test/e2e/storage/drivers.(*localVolume).DeleteVolume(0xc003ceaea8?) test/e2e/storage/drivers/in_tree.go:1952 +0x28 k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0x7ac14c8?) test/e2e/storage/utils/utils.go:714 +0x6d k8s.io/kubernetes/test/e2e/storage/framework.(*VolumeResource).CleanupResource(0xc001474300) test/e2e/storage/framework/volume_resource.go:231 +0xc6d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func2() test/e2e/storage/testsuites/subpath.go:179 +0x12d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func17() test/e2e/storage/testsuites/subpath.go:395 +0x203 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x2501d01?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000502340, 0x746f348) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting pod hostexec-bootstrap-e2e-minion-group-kv80-qv6bg in namespace provisioning-2498 [AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Collecting events from namespace "provisioning-2498". �[1mSTEP�[0m: Found 16 events. Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:04 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-qv6bg: {default-scheduler } Scheduled: Successfully assigned provisioning-2498/hostexec-bootstrap-e2e-minion-group-kv80-qv6bg to bootstrap-e2e-minion-group-kv80 Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:06 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-qv6bg: {kubelet bootstrap-e2e-minion-group-kv80} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:06 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-qv6bg: {kubelet bootstrap-e2e-minion-group-kv80} Created: Created container agnhost-container Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:06 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-qv6bg: {kubelet bootstrap-e2e-minion-group-kv80} Started: Started container agnhost-container Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:15 +0000 UTC - event for pvc-ttzb9: {persistentvolume-controller } ProvisioningFailed: storageclass.storage.k8s.io "provisioning-2498" not found Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:19 +0000 UTC - event for pod-subpath-test-preprovisionedpv-qwnj: {default-scheduler } Scheduled: Successfully assigned provisioning-2498/pod-subpath-test-preprovisionedpv-qwnj to bootstrap-e2e-minion-group-kv80 Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:23 +0000 UTC - event for pod-subpath-test-preprovisionedpv-qwnj: {kubelet bootstrap-e2e-minion-group-kv80} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:23 +0000 UTC - event for pod-subpath-test-preprovisionedpv-qwnj: {kubelet bootstrap-e2e-minion-group-kv80} Created: Created container init-volume-preprovisionedpv-qwnj Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:23 +0000 UTC - event for pod-subpath-test-preprovisionedpv-qwnj: {kubelet bootstrap-e2e-minion-group-kv80} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:23 +0000 UTC - event for pod-subpath-test-preprovisionedpv-qwnj: {kubelet bootstrap-e2e-minion-group-kv80} Created: Created container test-init-volume-preprovisionedpv-qwnj Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:23 +0000 UTC - event for pod-subpath-test-preprovisionedpv-qwnj: {kubelet bootstrap-e2e-minion-group-kv80} Started: Started container test-init-volume-preprovisionedpv-qwnj Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:23 +0000 UTC - event for pod-subpath-test-preprovisionedpv-qwnj: {kubelet bootstrap-e2e-minion-group-kv80} Started: Started container init-volume-preprovisionedpv-qwnj Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:24 +0000 UTC - event for pod-subpath-test-preprovisionedpv-qwnj: {kubelet bootstrap-e2e-minion-group-kv80} Started: Started container test-container-subpath-preprovisionedpv-qwnj Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:24 +0000 UTC - event for pod-subpath-test-preprovisionedpv-qwnj: {kubelet bootstrap-e2e-minion-group-kv80} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:07:05.789: INFO: At 2022-06-26 10:06:24 +0000 UTC - event for pod-subpath-test-preprovisionedpv-qwnj: {kubelet bootstrap-e2e-minion-group-kv80} Created: Created container test-container-subpath-preprovisionedpv-qwnj Jun 26 10:07:05.789: INFO: At 2022-06-26 10:07:05 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-kv80-qv6bg: {kubelet bootstrap-e2e-minion-group-kv80} Killing: Stopping container agnhost-container Jun 26 10:07:05.842: INFO: POD NODE PHASE GRACE CONDITIONS Jun 26 10:07:05.842: INFO: Jun 26 10:07:05.939: INFO: Logging node info for node bootstrap-e2e-master Jun 26 10:07:05.988: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 96f3154f-aacc-400a-ad66-d67f41c6b36b 9275 0 2022-06-26 10:01:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860045824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597901824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.168.138.173,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:948953d461317864b1fe4464d95c432a,SystemUUID:948953d4-6131-7864-b1fe-4464d95c432a,BootID:e5607f80-4a27-4601-af47-005a2514594d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:127703507,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:117521209,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:51075896,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:9870ed22905d03e3fa5cd2d57118784999fb581c49310f6cac0c3795bcdd7ee7 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.32],SizeBytes:17930113,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:05.988: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 26 10:07:06.037: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 26 10:07:06.134: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.134: INFO: Container kube-controller-manager ready: true, restart count 1 Jun 26 10:07:06.134: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.134: INFO: Container kube-scheduler ready: true, restart count 0 Jun 26 10:07:06.134: INFO: metadata-proxy-v0.1-79zmr started at 2022-06-26 10:01:13 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:06.134: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:06.134: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:06.135: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.135: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:06.135: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.135: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:06.135: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.135: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 26 10:07:06.135: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.135: INFO: Container kube-apiserver ready: true, restart count 0 Jun 26 10:07:06.135: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-26 10:00:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.135: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 26 10:07:06.135: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-26 10:00:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.135: INFO: Container l7-lb-controller ready: true, restart count 2 Jun 26 10:07:06.433: INFO: Latency metrics for node bootstrap-e2e-master Jun 26 10:07:06.433: INFO: Logging node info for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:06.482: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-kv80 8fe21414-4e64-490c-92b5-167dc1e64d0a 9403 0 2022-06-26 10:01:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-kv80 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-kv80 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:06:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:34 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-kv80,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.113.50,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b6c246299f5ddd34e63819759303fbd4,SystemUUID:b6c24629-9f5d-dd34-e638-19759303fbd4,BootID:b4e429f5-615d-4b99-b5eb-195153abb687,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:06.482: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:06.524: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:06.609: INFO: l7-default-backend-5f6f9745f9-95c2d started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container default-http-backend ready: true, restart count 0 Jun 26 10:07:06.609: INFO: konnectivity-agent-gh7lr started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:06.609: INFO: deployment-6c468f5898-sqsr7 started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:06.609: INFO: volume-snapshot-controller-0 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 26 10:07:06.609: INFO: execpod-affinityt97jd started at 2022-06-26 10:06:40 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:06.609: INFO: exec-volume-test-preprovisionedpv-4n4l started at 2022-06-26 10:07:04 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container exec-container-preprovisionedpv-4n4l ready: false, restart count 0 Jun 26 10:07:06.609: INFO: hostexec-bootstrap-e2e-minion-group-kv80-mvclh started at 2022-06-26 10:06:57 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:06.609: INFO: hostexec-bootstrap-e2e-minion-group-kv80-ssdb5 started at 2022-06-26 10:06:08 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:06.609: INFO: affinity-nodeport-timeout-2259x started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:06.609: INFO: kube-proxy-bootstrap-e2e-minion-group-kv80 started at 2022-06-26 10:01:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:06.609: INFO: npd-v0.8.9-vsk67 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:06.609: INFO: dns-test-3c2cd7d3-edb0-4970-a414-32648a9f811e started at 2022-06-26 10:06:43 +0000 UTC (0+3 container statuses recorded) Jun 26 10:07:06.609: INFO: Container jessie-querier ready: true, restart count 0 Jun 26 10:07:06.609: INFO: Container querier ready: true, restart count 0 Jun 26 10:07:06.609: INFO: Container webserver ready: true, restart count 0 Jun 26 10:07:06.609: INFO: pfpod started at 2022-06-26 10:06:51 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:06.609: INFO: Container portforwardtester ready: false, restart count 0 Jun 26 10:07:06.609: INFO: Container readiness ready: false, restart count 0 Jun 26 10:07:06.609: INFO: metadata-proxy-v0.1-glv9b started at 2022-06-26 10:01:12 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:06.609: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:06.609: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:06.609: INFO: coredns-85bc9d67b-2pcch started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:06.609: INFO: hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 started at 2022-06-26 10:06:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:06.609: INFO: deployment-5cd6f9c8c9-pm2kh started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:06.609: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:06.918: INFO: Latency metrics for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:06.918: INFO: Logging node info for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:06.980: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l6r5 bcf9cd6e-4842-45b7-9f21-7de490b4df8c 9626 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l6r5 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l6r5 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6165":"bootstrap-e2e-minion-group-l6r5","csi-mock-csi-mock-volumes-9260":"bootstrap-e2e-minion-group-l6r5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-06-26 10:01:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:07:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} }]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-l6r5,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-06-26 10:06:59 +0000 UTC,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoExecute,TimeAdded:2022-06-26 10:07:04 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:35.227.167.115,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5bb667ad496693fbfa6f2dcbfb63cab,SystemUUID:f5bb667a-d496-693f-bfa6-f2dcbfb63cab,BootID:730f0552-4b2a-4a66-b12d-5824a7e7a976,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858,DevicePath:,},},Config:nil,},} Jun 26 10:07:06.980: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:07.036: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:07.132: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l6r5: error trying to reach service: dial tcp 10.138.0.5:10250: connect: connection refused Jun 26 10:07:07.132: INFO: Logging node info for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:07.211: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-w1f4 aa1194c1-9599-41dd-8e29-c249fef7248e 9523 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-w1f4 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-w1f4 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:04:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-w1f4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.185.251.58,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38c15cfcea7d87fcfdfb495c46c9f2bd,SystemUUID:38c15cfc-ea7d-87fc-fdfb-495c46c9f2bd,BootID:f547655d-3f0b-4b8f-9e52-ac7560e71bb7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:07.211: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:07.316: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:07.435: INFO: rand-non-local-gxjbx started at 2022-06-26 10:07:01 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container c ready: false, restart count 0 Jun 26 10:07:07.435: INFO: kube-dns-autoscaler-5477bd659c-hwxn2 started at 2022-06-26 10:06:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container autoscaler ready: true, restart count 0 Jun 26 10:07:07.435: INFO: hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc started at 2022-06-26 10:06:27 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:07.435: INFO: service-headless-toggled-flcct started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:07.435: INFO: npd-v0.8.9-hzvbm started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:07.435: INFO: liveness-1ffb8679-e880-42c5-9594-e7ce6b90aafe started at 2022-06-26 10:04:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:07.435: INFO: adopt-release-stg6s started at 2022-06-26 10:06:09 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container c ready: true, restart count 0 Jun 26 10:07:07.435: INFO: adopt-release-s5pmp started at 2022-06-26 10:06:09 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container c ready: true, restart count 0 Jun 26 10:07:07.435: INFO: test-grpc-0024d73f-6f4d-4e93-a689-31d246e3fd09 started at 2022-06-26 10:05:32 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container etcd ready: true, restart count 0 Jun 26 10:07:07.435: INFO: metadata-proxy-v0.1-lj6mb started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:07.435: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:07.435: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:07.435: INFO: rand-non-local-9thk7 started at 2022-06-26 10:06:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container c ready: false, restart count 0 Jun 26 10:07:07.435: INFO: rand-non-local-rcw7v started at 2022-06-26 10:06:45 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container c ready: false, restart count 0 Jun 26 10:07:07.435: INFO: hairpin started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:07.435: INFO: service-headless-rfn2p started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:07.435: INFO: affinity-nodeport-timeout-pf8ht started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:07.435: INFO: verify-service-up-host-exec-pod started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:07.435: INFO: kube-proxy-bootstrap-e2e-minion-group-w1f4 started at 2022-06-26 10:01:19 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:07.435: INFO: konnectivity-agent-8w8st started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:07.435: INFO: pod-projected-secrets-d0859f57-a6b7-4b81-be26-970fd1a684b4 started at 2022-06-26 10:05:58 +0000 UTC (0+3 container statuses recorded) Jun 26 10:07:07.435: INFO: Container creates-volume-test ready: true, restart count 0 Jun 26 10:07:07.435: INFO: Container dels-volume-test ready: true, restart count 0 Jun 26 10:07:07.435: INFO: Container upds-volume-test ready: true, restart count 0 Jun 26 10:07:07.435: INFO: deployment-5cd6f9c8c9-2s82l started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:07.435: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:07.773: INFO: Latency metrics for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:07.774: INFO: Logging node info for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:07.839: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-zvd6 465e1e7d-9f60-42b7-acea-e8cd1dca80e2 9527 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-zvd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-zvd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2385":"bootstrap-e2e-minion-group-zvd6","csi-hostpath-provisioning-6151":"bootstrap-e2e-minion-group-zvd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-26 10:06:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-zvd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.91.218,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aa6080e0da2673fad5141cc4863e32c,SystemUUID:4aa6080e-0da2-673f-ad51-41cc4863e32c,BootID:628a7f46-4bbe-40bc-aa89-4f2b41dd6222,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62,DevicePath:,},},Config:nil,},} Jun 26 10:07:07.839: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:07.890: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:08.014: INFO: default started at 2022-06-26 10:06:44 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:08.014: INFO: affinity-nodeport-timeout-4b548 started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:08.014: INFO: metadata-proxy-v0.1-hrd5b started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:08.014: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:08.014: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:06:28 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:08.014: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:08.014: INFO: verify-service-up-exec-pod-85m6b started at 2022-06-26 10:06:26 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:08.014: INFO: coredns-85bc9d67b-6grvl started at 2022-06-26 10:05:59 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:08.014: INFO: private started at 2022-06-26 10:06:42 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:08.014: INFO: kube-proxy-bootstrap-e2e-minion-group-zvd6 started at 2022-06-26 10:01:20 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:08.014: INFO: npd-v0.8.9-w26wg started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:08.014: INFO: konnectivity-agent-thvrv started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:08.014: INFO: inline-volume-tester-nkqft started at 2022-06-26 10:05:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container csi-volume-tester ready: true, restart count 0 Jun 26 10:07:08.014: INFO: service-headless-toggled-27ccn started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:08.014: INFO: service-headless-lrtx9 started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:08.014: INFO: master started at 2022-06-26 10:06:35 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:08.014: INFO: adopt-release-brsdt started at 2022-06-26 10:06:21 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container c ready: false, restart count 0 Jun 26 10:07:08.014: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:05:43 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:08.014: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:08.014: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:08.014: INFO: slave started at 2022-06-26 10:06:39 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:08.014: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:08.316: INFO: Latency metrics for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:08.316: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready Jun 26 10:07:08.376: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:10.498: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:12.491: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:14.493: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:16.536: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:18.503: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:20.547: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:22.499: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:24.592: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:26.512: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:28.528: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:30.505: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:32.500: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:34.505: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:36.495: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:38.511: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:40.499: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:42.501: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:44.522: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:46.521: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:48.514: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:50.512: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:52.519: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:54.505: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:56.540: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:58.551: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:08:00.501: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:08:02.514: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:04.488: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:06.485: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:08.488: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:10.482: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:12.483: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:14.489: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure �[1mSTEP�[0m: Destroying namespace "provisioning-2498" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sPersistentVolumes\sNFS\swith\smultiple\sPVs\sand\sPVCs\sall\sin\ssame\sns\sshould\screate\s2\sPVs\sand\s4\sPVCs\:\stest\swrite\saccess$'
test/e2e/storage/persistent_volumes.go:131 Jun 26 10:06:49.345: error running /workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.168.138.173 --kubeconfig=/workspace/.kube/config --namespace=pv-8255 logs nfs-server nfs-server: Command stdout: stderr: Error from server: Get "https://10.138.0.5:10250/containerLogs/pv-8255/nfs-server/nfs-server": dial tcp 10.138.0.5:10250: connect: connection refused error: exit status 1 test/e2e/framework/util.go:629from junit_29.xml
[BeforeEach] [sig-storage] PersistentVolumes test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 26 10:06:13.191: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename pv �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-storage] PersistentVolumes test/e2e/storage/persistent_volumes.go:114 [BeforeEach] NFS test/e2e/storage/persistent_volumes.go:131 �[1mSTEP�[0m: creating nfs-server pod Jun 26 10:06:13.548: INFO: Waiting up to 5m0s for pod "nfs-server" in namespace "pv-8255" to be "running" Jun 26 10:06:13.594: INFO: Pod "nfs-server": Phase="Pending", Reason="", readiness=false. Elapsed: 46.589846ms Jun 26 10:06:15.634: INFO: Pod "nfs-server": Phase="Pending", Reason="", readiness=false. Elapsed: 2.08683979s Jun 26 10:06:17.665: INFO: Pod "nfs-server": Phase="Running", Reason="", readiness=true. Elapsed: 4.117330732s Jun 26 10:06:17.665: INFO: Pod "nfs-server" satisfied condition "running" �[1mSTEP�[0m: locating the "nfs-server" server pod Jun 26 10:06:17.775: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.168.138.173 --kubeconfig=/workspace/.kube/config --namespace=pv-8255 logs nfs-server nfs-server' Jun 26 10:06:18.076: INFO: stderr: "" Jun 26 10:06:18.076: INFO: stdout: "Serving /exports\nrpcinfo: can't contact rpcbind: : RPC: Unable to receive; errno = Connection refused\nStarting rpcbind\n" Jun 26 10:06:20.077: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.168.138.173 --kubeconfig=/workspace/.kube/config --namespace=pv-8255 logs nfs-server nfs-server' Jun 26 10:06:20.384: INFO: stderr: "" Jun 26 10:06:20.384: INFO: stdout: "Serving /exports\nrpcinfo: can't contact rpcbind: : RPC: Unable to receive; errno = Connection refused\nStarting rpcbind\n" Jun 26 10:06:22.385: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.168.138.173 --kubeconfig=/workspace/.kube/config --namespace=pv-8255 logs nfs-server nfs-server' Jun 26 10:06:49.344: INFO: rc: 1 Jun 26 10:06:49.345: INFO: Unexpected error: <exec.CodeExitError>: { Err: { s: "error running /workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.168.138.173 --kubeconfig=/workspace/.kube/config --namespace=pv-8255 logs nfs-server nfs-server:\nCommand stdout:\n\nstderr:\nError from server: Get \"https://10.138.0.5:10250/containerLogs/pv-8255/nfs-server/nfs-server\": dial tcp 10.138.0.5:10250: connect: connection refused\n\nerror:\nexit status 1", }, Code: 1, } Jun 26 10:06:49.345: FAIL: error running /workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.168.138.173 --kubeconfig=/workspace/.kube/config --namespace=pv-8255 logs nfs-server nfs-server: Command stdout: stderr: Error from server: Get "https://10.138.0.5:10250/containerLogs/pv-8255/nfs-server/nfs-server": dial tcp 10.138.0.5:10250: connect: connection refused error: exit status 1 Full Stack Trace k8s.io/kubernetes/test/e2e/framework.KubectlBuilder.ExecOrDie({0xc0027ab080?, 0x0?}, {0xc0027866f0, 0x7}) test/e2e/framework/util.go:629 +0x1b4 k8s.io/kubernetes/test/e2e/framework.RunKubectlOrDie({0xc0027866f0, 0x7}, {0xc004f088b8?, 0x3a99692b6a?, 0x0?}) test/e2e/framework/util.go:691 +0x45 k8s.io/kubernetes/test/e2e/framework.LookForStringInLog.func1() test/e2e/framework/util.go:1202 +0x79 k8s.io/kubernetes/test/e2e/framework.lookForString({0x71cc033, 0xb}, 0x29e8d60800, 0xc002dfe9a8) test/e2e/framework/util.go:569 +0xb2 k8s.io/kubernetes/test/e2e/framework.LookForStringInLog({0xc0027866f0?, 0x0?}, {0xc0027866e0?, 0xc002759590?}, {0xc002786446?, 0x0?}, {0x71cc033?, 0x7a92690?}, 0xc00007c0f0?) test/e2e/framework/util.go:1201 +0x87 k8s.io/kubernetes/test/e2e/framework/volume.startVolumeServer({0x7ac14c8, 0xc00220cf00}, {{0xc002479349, 0x7}, {0x71b96d0, 0x3}, {0xc003a5b8c0, 0x2e}, {0xc002786430, 0x1, ...}, ...}) test/e2e/framework/volume/fixtures.go:416 +0x10f6 k8s.io/kubernetes/test/e2e/framework/volume.CreateStorageServer({0x7ac14c8?, 0xc00220cf00?}, {{0xc002479349, 0x7}, {0x71b96d0, 0x3}, {0xc003a5b8c0, 0x2e}, {0xc002786430, 0x1, ...}, ...}) test/e2e/framework/volume/fixtures.go:232 +0x78 k8s.io/kubernetes/test/e2e/framework/volume.NewNFSServer({0x7ac14c8, 0xc00220cf00}, {0xc002479349, 0x7}, {0xc002758ed0, 0x3, 0x3}) test/e2e/framework/volume/fixtures.go:162 +0x308 k8s.io/kubernetes/test/e2e/storage.glob..func24.2.1() test/e2e/storage/persistent_volumes.go:132 +0x10b k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x2501d19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000833d40, 0x746f348) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f [AfterEach] NFS test/e2e/storage/persistent_volumes.go:151 [AfterEach] [sig-storage] PersistentVolumes test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Collecting events from namespace "pv-8255". �[1mSTEP�[0m: Found 4 events. Jun 26 10:06:49.381: INFO: At 2022-06-26 10:06:13 +0000 UTC - event for nfs-server: {default-scheduler } Scheduled: Successfully assigned pv-8255/nfs-server to bootstrap-e2e-minion-group-l6r5 Jun 26 10:06:49.381: INFO: At 2022-06-26 10:06:14 +0000 UTC - event for nfs-server: {kubelet bootstrap-e2e-minion-group-l6r5} Pulled: Container image "registry.k8s.io/e2e-test-images/volume/nfs:1.3" already present on machine Jun 26 10:06:49.381: INFO: At 2022-06-26 10:06:14 +0000 UTC - event for nfs-server: {kubelet bootstrap-e2e-minion-group-l6r5} Created: Created container nfs-server Jun 26 10:06:49.381: INFO: At 2022-06-26 10:06:14 +0000 UTC - event for nfs-server: {kubelet bootstrap-e2e-minion-group-l6r5} Started: Started container nfs-server Jun 26 10:06:49.416: INFO: POD NODE PHASE GRACE CONDITIONS Jun 26 10:06:49.416: INFO: nfs-server bootstrap-e2e-minion-group-l6r5 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:13 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:14 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:14 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:13 +0000 UTC }] Jun 26 10:06:49.416: INFO: Jun 26 10:06:49.474: INFO: Unable to fetch pv-8255/nfs-server/nfs-server logs: an error on the server ("unknown") has prevented the request from succeeding (get pods nfs-server) Jun 26 10:06:49.580: INFO: Logging node info for node bootstrap-e2e-master Jun 26 10:06:49.623: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 96f3154f-aacc-400a-ad66-d67f41c6b36b 9275 0 2022-06-26 10:01:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860045824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597901824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.168.138.173,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:948953d461317864b1fe4464d95c432a,SystemUUID:948953d4-6131-7864-b1fe-4464d95c432a,BootID:e5607f80-4a27-4601-af47-005a2514594d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:127703507,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:117521209,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:51075896,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:9870ed22905d03e3fa5cd2d57118784999fb581c49310f6cac0c3795bcdd7ee7 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.32],SizeBytes:17930113,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:06:49.624: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 26 10:06:49.662: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 26 10:06:54.668: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:54.668: INFO: Container kube-controller-manager ready: true, restart count 1 Jun 26 10:06:54.668: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:54.668: INFO: Container kube-scheduler ready: true, restart count 0 Jun 26 10:06:54.668: INFO: metadata-proxy-v0.1-79zmr started at 2022-06-26 10:01:13 +0000 UTC (0+2 container statuses recorded) Jun 26 10:06:54.668: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:06:54.668: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:06:54.668: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:54.668: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:06:54.668: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:54.668: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:06:54.668: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:54.668: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 26 10:06:54.668: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:54.668: INFO: Container kube-apiserver ready: true, restart count 0 Jun 26 10:06:54.668: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-26 10:00:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:54.668: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 26 10:06:54.668: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-26 10:00:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:54.668: INFO: Container l7-lb-controller ready: true, restart count 2 Jun 26 10:06:55.032: INFO: Latency metrics for node bootstrap-e2e-master Jun 26 10:06:55.032: INFO: Logging node info for node bootstrap-e2e-minion-group-kv80 Jun 26 10:06:55.082: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-kv80 8fe21414-4e64-490c-92b5-167dc1e64d0a 9403 0 2022-06-26 10:01:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-kv80 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-kv80 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:06:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:34 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-kv80,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.113.50,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b6c246299f5ddd34e63819759303fbd4,SystemUUID:b6c24629-9f5d-dd34-e638-19759303fbd4,BootID:b4e429f5-615d-4b99-b5eb-195153abb687,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:06:55.083: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-kv80 Jun 26 10:06:55.130: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-kv80 Jun 26 10:06:55.239: INFO: npd-v0.8.9-vsk67 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:06:55.239: INFO: kube-proxy-bootstrap-e2e-minion-group-kv80 started at 2022-06-26 10:01:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:06:55.239: INFO: pfpod started at 2022-06-26 10:06:51 +0000 UTC (0+2 container statuses recorded) Jun 26 10:06:55.239: INFO: Container portforwardtester ready: true, restart count 0 Jun 26 10:06:55.239: INFO: Container readiness ready: false, restart count 0 Jun 26 10:06:55.239: INFO: hostexec-bootstrap-e2e-minion-group-kv80-qv6bg started at 2022-06-26 10:06:04 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:06:55.239: INFO: dns-test-3c2cd7d3-edb0-4970-a414-32648a9f811e started at 2022-06-26 10:06:43 +0000 UTC (0+3 container statuses recorded) Jun 26 10:06:55.239: INFO: Container jessie-querier ready: true, restart count 0 Jun 26 10:06:55.239: INFO: Container querier ready: true, restart count 0 Jun 26 10:06:55.239: INFO: Container webserver ready: true, restart count 0 Jun 26 10:06:55.239: INFO: coredns-85bc9d67b-2pcch started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container coredns ready: true, restart count 0 Jun 26 10:06:55.239: INFO: hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 started at 2022-06-26 10:06:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:06:55.239: INFO: deployment-5cd6f9c8c9-pm2kh started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container nginx ready: false, restart count 0 Jun 26 10:06:55.239: INFO: apparmor-loader-9hjnl started at 2022-06-26 10:06:30 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container apparmor-loader ready: true, restart count 0 Jun 26 10:06:55.239: INFO: metadata-proxy-v0.1-glv9b started at 2022-06-26 10:01:12 +0000 UTC (0+2 container statuses recorded) Jun 26 10:06:55.239: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:06:55.239: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:06:55.239: INFO: konnectivity-agent-gh7lr started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:06:55.239: INFO: deployment-6c468f5898-sqsr7 started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container nginx ready: false, restart count 0 Jun 26 10:06:55.239: INFO: replace-27603965-4krdm started at 2022-06-26 10:05:00 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container c ready: false, restart count 0 Jun 26 10:06:55.239: INFO: l7-default-backend-5f6f9745f9-95c2d started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container default-http-backend ready: true, restart count 0 Jun 26 10:06:55.239: INFO: execpod-affinityt97jd started at 2022-06-26 10:06:40 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:06:55.239: INFO: volume-snapshot-controller-0 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 26 10:06:55.239: INFO: test-rs-zw7jg started at 2022-06-26 10:06:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container httpd ready: true, restart count 0 Jun 26 10:06:55.239: INFO: hostexec-bootstrap-e2e-minion-group-kv80-ssdb5 started at 2022-06-26 10:06:08 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:06:55.239: INFO: affinity-nodeport-timeout-2259x started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.239: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:06:55.545: INFO: Latency metrics for node bootstrap-e2e-minion-group-kv80 Jun 26 10:06:55.545: INFO: Logging node info for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:06:55.592: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l6r5 bcf9cd6e-4842-45b7-9f21-7de490b4df8c 8414 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l6r5 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l6r5 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6165":"bootstrap-e2e-minion-group-l6r5","csi-mock-csi-mock-volumes-9260":"bootstrap-e2e-minion-group-l6r5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-26 10:01:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:04:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-06-26 10:06:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-l6r5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:01:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:35.227.167.115,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5bb667ad496693fbfa6f2dcbfb63cab,SystemUUID:f5bb667a-d496-693f-bfa6-f2dcbfb63cab,BootID:730f0552-4b2a-4a66-b12d-5824a7e7a976,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858,DevicePath:,},},Config:nil,},} Jun 26 10:06:55.593: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:06:55.645: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l6r5 Jun 26 10:06:55.725: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l6r5: error trying to reach service: dial tcp 10.138.0.5:10250: connect: connection refused Jun 26 10:06:55.725: INFO: Logging node info for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:06:55.773: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-w1f4 aa1194c1-9599-41dd-8e29-c249fef7248e 9277 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-w1f4 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-w1f4 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:04:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-w1f4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:26 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:26 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:26 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:26 +0000 UTC,LastTransitionTime:2022-06-26 10:01:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.185.251.58,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38c15cfcea7d87fcfdfb495c46c9f2bd,SystemUUID:38c15cfc-ea7d-87fc-fdfb-495c46c9f2bd,BootID:f547655d-3f0b-4b8f-9e52-ac7560e71bb7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:06:55.774: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:06:55.822: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-w1f4 Jun 26 10:06:55.913: INFO: service-headless-rfn2p started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:06:55.913: INFO: affinity-nodeport-timeout-pf8ht started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:06:55.913: INFO: verify-service-up-host-exec-pod started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:06:55.913: INFO: kube-proxy-bootstrap-e2e-minion-group-w1f4 started at 2022-06-26 10:01:19 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:06:55.913: INFO: konnectivity-agent-8w8st started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:06:55.913: INFO: pod-projected-secrets-d0859f57-a6b7-4b81-be26-970fd1a684b4 started at 2022-06-26 10:05:58 +0000 UTC (0+3 container statuses recorded) Jun 26 10:06:55.913: INFO: Container creates-volume-test ready: true, restart count 0 Jun 26 10:06:55.913: INFO: Container dels-volume-test ready: true, restart count 0 Jun 26 10:06:55.913: INFO: Container upds-volume-test ready: true, restart count 0 Jun 26 10:06:55.913: INFO: deployment-5cd6f9c8c9-2s82l started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container nginx ready: false, restart count 0 Jun 26 10:06:55.913: INFO: busybox-user-65534-a6d2b8c0-9274-40fe-9f0c-434b0170f4a4 started at 2022-06-26 10:06:44 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container busybox-user-65534-a6d2b8c0-9274-40fe-9f0c-434b0170f4a4 ready: false, restart count 0 Jun 26 10:06:55.913: INFO: kube-dns-autoscaler-5477bd659c-hwxn2 started at 2022-06-26 10:06:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container autoscaler ready: true, restart count 0 Jun 26 10:06:55.913: INFO: hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc started at 2022-06-26 10:06:27 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:06:55.913: INFO: service-headless-toggled-flcct started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:06:55.913: INFO: npd-v0.8.9-hzvbm started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:06:55.913: INFO: liveness-1ffb8679-e880-42c5-9594-e7ce6b90aafe started at 2022-06-26 10:04:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:06:55.913: INFO: adopt-release-stg6s started at 2022-06-26 10:06:09 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container c ready: true, restart count 0 Jun 26 10:06:55.913: INFO: adopt-release-s5pmp started at 2022-06-26 10:06:09 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container c ready: true, restart count 0 Jun 26 10:06:55.913: INFO: test-grpc-0024d73f-6f4d-4e93-a689-31d246e3fd09 started at 2022-06-26 10:05:32 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container etcd ready: true, restart count 0 Jun 26 10:06:55.913: INFO: metadata-proxy-v0.1-lj6mb started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:06:55.913: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:06:55.913: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:06:55.913: INFO: rand-non-local-9thk7 started at 2022-06-26 10:06:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container c ready: false, restart count 0 Jun 26 10:06:55.913: INFO: rand-non-local-rcw7v started at 2022-06-26 10:06:45 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container c ready: false, restart count 0 Jun 26 10:06:55.913: INFO: hairpin started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:55.913: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:06:56.148: INFO: Latency metrics for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:06:56.148: INFO: Logging node info for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:06:56.193: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-zvd6 465e1e7d-9f60-42b7-acea-e8cd1dca80e2 9393 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-zvd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-zvd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2385":"bootstrap-e2e-minion-group-zvd6","csi-hostpath-provisioning-6151":"bootstrap-e2e-minion-group-zvd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-26 10:06:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-06-26 10:06:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-zvd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:46 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:46 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:46 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:46 +0000 UTC,LastTransitionTime:2022-06-26 10:01:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.91.218,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aa6080e0da2673fad5141cc4863e32c,SystemUUID:4aa6080e-0da2-673f-ad51-41cc4863e32c,BootID:628a7f46-4bbe-40bc-aa89-4f2b41dd6222,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62 kubernetes.io/csi/csi-hostpath-ephemeral-2385^96500654-f537-11ec-ad12-4e9ead5b3a62],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2385^96500654-f537-11ec-ad12-4e9ead5b3a62,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62,DevicePath:,},},Config:nil,},} Jun 26 10:06:56.193: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:06:56.261: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-zvd6 Jun 26 10:06:56.437: INFO: konnectivity-agent-thvrv started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:06:56.437: INFO: kube-proxy-bootstrap-e2e-minion-group-zvd6 started at 2022-06-26 10:01:20 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:06:56.437: INFO: npd-v0.8.9-w26wg started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:06:56.437: INFO: master started at 2022-06-26 10:06:35 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container cntr ready: true, restart count 0 Jun 26 10:06:56.437: INFO: adopt-release-brsdt started at 2022-06-26 10:06:21 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container c ready: false, restart count 0 Jun 26 10:06:56.437: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:05:43 +0000 UTC (0+7 container statuses recorded) Jun 26 10:06:56.437: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:06:56.437: INFO: slave started at 2022-06-26 10:06:39 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container cntr ready: true, restart count 0 Jun 26 10:06:56.437: INFO: inline-volume-tester-nkqft started at 2022-06-26 10:05:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container csi-volume-tester ready: true, restart count 0 Jun 26 10:06:56.437: INFO: service-headless-toggled-27ccn started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:06:56.437: INFO: service-headless-lrtx9 started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:06:56.437: INFO: hostexec-bootstrap-e2e-minion-group-zvd6-2pw5k started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:06:56.437: INFO: pod-subpath-test-dynamicpv-ktnk started at 2022-06-26 10:06:34 +0000 UTC (2+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Init container init-volume-dynamicpv-ktnk ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Init container test-init-volume-dynamicpv-ktnk ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container test-container-subpath-dynamicpv-ktnk ready: false, restart count 0 Jun 26 10:06:56.437: INFO: default started at 2022-06-26 10:06:44 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container cntr ready: true, restart count 0 Jun 26 10:06:56.437: INFO: affinity-nodeport-timeout-4b548 started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:06:56.437: INFO: verify-service-up-exec-pod-85m6b started at 2022-06-26 10:06:26 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:06:56.437: INFO: coredns-85bc9d67b-6grvl started at 2022-06-26 10:05:59 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container coredns ready: true, restart count 0 Jun 26 10:06:56.437: INFO: private started at 2022-06-26 10:06:42 +0000 UTC (0+1 container statuses recorded) Jun 26 10:06:56.437: INFO: Container cntr ready: true, restart count 0 Jun 26 10:06:56.437: INFO: metadata-proxy-v0.1-hrd5b started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:06:56.437: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:06:56.437: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:06:28 +0000 UTC (0+7 container statuses recorded) Jun 26 10:06:56.437: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:06:56.437: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:06:56.749: INFO: Latency metrics for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:06:56.749: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "pv-8255" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sPersistentVolumes\-local\s\s\[Volume\stype\:\stmpfs\]\sOne\spod\srequesting\sone\sprebound\sPVC\sshould\sbe\sable\sto\smount\svolume\sand\swrite\sfrom\spod1$'
test/e2e/storage/persistent_volumes-local.go:206 Jun 26 10:07:09.533: error dialing backend: dial timeout, backstop test/e2e/storage/utils/local.go:119from junit_16.xml
[BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Creating a kubernetes client Jun 26 10:06:26.643: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename persistent-local-volumes-test �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:160 [BeforeEach] [Volume type: tmpfs] test/e2e/storage/persistent_volumes-local.go:197 �[1mSTEP�[0m: Initializing test volumes �[1mSTEP�[0m: Creating tmpfs mount point on node "bootstrap-e2e-minion-group-w1f4" at path "/tmp/local-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c" Jun 26 10:06:27.098: INFO: Waiting up to 5m0s for pod "hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc" in namespace "persistent-local-volumes-test-1568" to be "running" Jun 26 10:06:27.139: INFO: Pod "hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc": Phase="Pending", Reason="", readiness=false. Elapsed: 40.919353ms Jun 26 10:06:29.188: INFO: Pod "hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.089501261s Jun 26 10:06:31.184: INFO: Pod "hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.085670555s Jun 26 10:06:33.180: INFO: Pod "hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc": Phase="Running", Reason="", readiness=true. Elapsed: 6.081851131s Jun 26 10:06:33.180: INFO: Pod "hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc" satisfied condition "running" Jun 26 10:06:33.180: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p "/tmp/local-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c" && mount -t tmpfs -o size=10m tmpfs-"/tmp/local-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c" "/tmp/local-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c"] Namespace:persistent-local-volumes-test-1568 PodName:hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:33.180: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:33.182: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:33.182: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/persistent-local-volumes-test-1568/pods/hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%22%2Ftmp%2Flocal-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c%22+%26%26+mount+-t+tmpfs+-o+size%3D10m+tmpfs-%22%2Ftmp%2Flocal-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c%22+%22%2Ftmp%2Flocal-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c%22&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) �[1mSTEP�[0m: Creating local PVCs and PVs Jun 26 10:06:33.497: INFO: Creating a PV followed by a PVC Jun 26 10:06:33.580: INFO: Waiting for PV local-pvnp64t to bind to PVC pvc-npdlk Jun 26 10:06:33.580: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-npdlk] to have phase Bound Jun 26 10:06:33.641: INFO: PersistentVolumeClaim pvc-npdlk found but phase is Pending instead of Bound. Jun 26 10:06:35.682: INFO: PersistentVolumeClaim pvc-npdlk found and phase=Bound (2.101884088s) Jun 26 10:06:35.682: INFO: Waiting up to 3m0s for PersistentVolume local-pvnp64t to have phase Bound Jun 26 10:06:35.718: INFO: PersistentVolume local-pvnp64t found and phase=Bound (35.426927ms) [BeforeEach] One pod requesting one prebound PVC test/e2e/storage/persistent_volumes-local.go:217 �[1mSTEP�[0m: Creating pod1 �[1mSTEP�[0m: Creating a pod Jun 26 10:06:35.864: INFO: Waiting up to 5m0s for pod "pod-08ed632f-8583-4f7e-8e18-3b02e4dae418" in namespace "persistent-local-volumes-test-1568" to be "running" Jun 26 10:06:35.908: INFO: Pod "pod-08ed632f-8583-4f7e-8e18-3b02e4dae418": Phase="Pending", Reason="", readiness=false. Elapsed: 43.790391ms Jun 26 10:06:37.948: INFO: Pod "pod-08ed632f-8583-4f7e-8e18-3b02e4dae418": Phase="Running", Reason="", readiness=true. Elapsed: 2.08379602s Jun 26 10:06:37.948: INFO: Pod "pod-08ed632f-8583-4f7e-8e18-3b02e4dae418" satisfied condition "running" Jun 26 10:06:38.021: INFO: pod "pod-08ed632f-8583-4f7e-8e18-3b02e4dae418" created on Node "bootstrap-e2e-minion-group-w1f4" �[1mSTEP�[0m: Writing in pod1 Jun 26 10:06:38.021: INFO: ExecWithOptions {Command:[/bin/sh -c mkdir -p /mnt/volume1; echo test-file-content > /mnt/volume1/test-file] Namespace:persistent-local-volumes-test-1568 PodName:pod-08ed632f-8583-4f7e-8e18-3b02e4dae418 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:38.021: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:38.022: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:38.022: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/persistent-local-volumes-test-1568/pods/pod-08ed632f-8583-4f7e-8e18-3b02e4dae418/exec?command=%2Fbin%2Fsh&command=-c&command=mkdir+-p+%2Fmnt%2Fvolume1%3B+echo+test-file-content+%3E+%2Fmnt%2Fvolume1%2Ftest-file&container=write-pod&container=write-pod&stderr=true&stdout=true) Jun 26 10:06:38.347: INFO: podRWCmdExec cmd: "mkdir -p /mnt/volume1; echo test-file-content > /mnt/volume1/test-file", out: "", stderr: "", err: <nil> [It] should be able to mount volume and write from pod1 test/e2e/storage/persistent_volumes-local.go:240 Jun 26 10:06:38.347: INFO: ExecWithOptions {Command:[/bin/sh -c cat /mnt/volume1/test-file] Namespace:persistent-local-volumes-test-1568 PodName:pod-08ed632f-8583-4f7e-8e18-3b02e4dae418 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:38.347: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:38.349: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:38.349: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/persistent-local-volumes-test-1568/pods/pod-08ed632f-8583-4f7e-8e18-3b02e4dae418/exec?command=%2Fbin%2Fsh&command=-c&command=cat+%2Fmnt%2Fvolume1%2Ftest-file&container=write-pod&container=write-pod&stderr=true&stdout=true) Jun 26 10:06:38.653: INFO: podRWCmdExec cmd: "cat /mnt/volume1/test-file", out: "test-file-content", stderr: "", err: <nil> �[1mSTEP�[0m: Writing in pod1 Jun 26 10:06:38.653: INFO: ExecWithOptions {Command:[/bin/sh -c mkdir -p /mnt/volume1; echo /tmp/local-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c > /mnt/volume1/test-file] Namespace:persistent-local-volumes-test-1568 PodName:pod-08ed632f-8583-4f7e-8e18-3b02e4dae418 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Jun 26 10:06:38.653: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:38.654: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:38.654: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/persistent-local-volumes-test-1568/pods/pod-08ed632f-8583-4f7e-8e18-3b02e4dae418/exec?command=%2Fbin%2Fsh&command=-c&command=mkdir+-p+%2Fmnt%2Fvolume1%3B+echo+%2Ftmp%2Flocal-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c+%3E+%2Fmnt%2Fvolume1%2Ftest-file&container=write-pod&container=write-pod&stderr=true&stdout=true) Jun 26 10:06:38.950: INFO: podRWCmdExec cmd: "mkdir -p /mnt/volume1; echo /tmp/local-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c > /mnt/volume1/test-file", out: "", stderr: "", err: <nil> [AfterEach] One pod requesting one prebound PVC test/e2e/storage/persistent_volumes-local.go:229 �[1mSTEP�[0m: Deleting pod1 �[1mSTEP�[0m: Deleting pod pod-08ed632f-8583-4f7e-8e18-3b02e4dae418 in namespace persistent-local-volumes-test-1568 [AfterEach] [Volume type: tmpfs] test/e2e/storage/persistent_volumes-local.go:206 �[1mSTEP�[0m: Cleaning up PVC and PV Jun 26 10:06:38.990: INFO: Deleting PersistentVolumeClaim "pvc-npdlk" Jun 26 10:06:39.033: INFO: Deleting PersistentVolume "local-pvnp64t" �[1mSTEP�[0m: Unmount tmpfs mount point on node "bootstrap-e2e-minion-group-w1f4" at path "/tmp/local-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c" Jun 26 10:06:39.072: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c umount "/tmp/local-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c"] Namespace:persistent-local-volumes-test-1568 PodName:hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:39.072: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:39.073: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:39.073: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/persistent-local-volumes-test-1568/pods/hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=umount+%22%2Ftmp%2Flocal-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c%22&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) �[1mSTEP�[0m: Removing the test directory Jun 26 10:06:39.417: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c] Namespace:persistent-local-volumes-test-1568 PodName:hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Jun 26 10:06:39.417: INFO: >>> kubeConfig: /workspace/.kube/config Jun 26 10:06:39.418: INFO: ExecWithOptions: Clientset creation Jun 26 10:06:39.418: INFO: ExecWithOptions: execute(POST https://34.168.138.173/api/v1/namespaces/persistent-local-volumes-test-1568/pods/hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Jun 26 10:07:09.532: INFO: exec bootstrap-e2e-minion-group-w1f4: command: rm -r /tmp/local-volume-test-70f77dcb-7c68-43a6-8f2e-96f1d197773c Jun 26 10:07:09.532: INFO: exec bootstrap-e2e-minion-group-w1f4: stdout: "" Jun 26 10:07:09.532: INFO: exec bootstrap-e2e-minion-group-w1f4: stderr: "" Jun 26 10:07:09.532: INFO: exec bootstrap-e2e-minion-group-w1f4: exit code: 0 Jun 26 10:07:09.532: INFO: Unexpected error: <*errors.StatusError | 0xc001624780>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } Jun 26 10:07:09.533: FAIL: error dialing backend: dial timeout, backstop Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).cleanupLocalVolumeTmpfs(0xc0030fa030, 0xc0021a7c00) test/e2e/storage/utils/local.go:119 +0x1d7 k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).Remove(0xc001934630?, 0xc004b12f08?) test/e2e/storage/utils/local.go:349 +0x8b k8s.io/kubernetes/test/e2e/storage.cleanupLocalVolumes(0xc001934630, {0xc004b12f08?, 0x1, 0x0?}) test/e2e/storage/persistent_volumes-local.go:863 +0x5b k8s.io/kubernetes/test/e2e/storage.glob..func23.2.2() test/e2e/storage/persistent_volumes-local.go:207 +0x47 k8s.io/kubernetes/test/e2e.RunE2ETests(0x2590617?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000e7a4e0, 0x746f348) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Collecting events from namespace "persistent-local-volumes-test-1568". �[1mSTEP�[0m: Found 9 events. Jun 26 10:07:09.583: INFO: At 2022-06-26 10:06:27 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc: {default-scheduler } Scheduled: Successfully assigned persistent-local-volumes-test-1568/hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc to bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:09.583: INFO: At 2022-06-26 10:06:28 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc: {kubelet bootstrap-e2e-minion-group-w1f4} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.39" already present on machine Jun 26 10:07:09.583: INFO: At 2022-06-26 10:06:28 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc: {kubelet bootstrap-e2e-minion-group-w1f4} Created: Created container agnhost-container Jun 26 10:07:09.583: INFO: At 2022-06-26 10:06:28 +0000 UTC - event for hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc: {kubelet bootstrap-e2e-minion-group-w1f4} Started: Started container agnhost-container Jun 26 10:07:09.583: INFO: At 2022-06-26 10:06:35 +0000 UTC - event for pod-08ed632f-8583-4f7e-8e18-3b02e4dae418: {default-scheduler } Scheduled: Successfully assigned persistent-local-volumes-test-1568/pod-08ed632f-8583-4f7e-8e18-3b02e4dae418 to bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:09.583: INFO: At 2022-06-26 10:06:36 +0000 UTC - event for pod-08ed632f-8583-4f7e-8e18-3b02e4dae418: {kubelet bootstrap-e2e-minion-group-w1f4} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine Jun 26 10:07:09.583: INFO: At 2022-06-26 10:06:36 +0000 UTC - event for pod-08ed632f-8583-4f7e-8e18-3b02e4dae418: {kubelet bootstrap-e2e-minion-group-w1f4} Created: Created container write-pod Jun 26 10:07:09.583: INFO: At 2022-06-26 10:06:36 +0000 UTC - event for pod-08ed632f-8583-4f7e-8e18-3b02e4dae418: {kubelet bootstrap-e2e-minion-group-w1f4} Started: Started container write-pod Jun 26 10:07:09.583: INFO: At 2022-06-26 10:06:39 +0000 UTC - event for pod-08ed632f-8583-4f7e-8e18-3b02e4dae418: {kubelet bootstrap-e2e-minion-group-w1f4} Killing: Stopping container write-pod Jun 26 10:07:09.632: INFO: POD NODE PHASE GRACE CONDITIONS Jun 26 10:07:09.632: INFO: hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc bootstrap-e2e-minion-group-w1f4 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:27 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:28 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:28 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-26 10:06:27 +0000 UTC }] Jun 26 10:07:09.632: INFO: Jun 26 10:07:09.799: INFO: Logging node info for node bootstrap-e2e-master Jun 26 10:07:09.851: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 96f3154f-aacc-400a-ad66-d67f41c6b36b 9275 0 2022-06-26 10:01:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860045824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597901824 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.168.138.173,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:948953d461317864b1fe4464d95c432a,SystemUUID:948953d4-6131-7864-b1fe-4464d95c432a,BootID:e5607f80-4a27-4601-af47-005a2514594d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:127703507,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:117521209,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:51075896,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:9870ed22905d03e3fa5cd2d57118784999fb581c49310f6cac0c3795bcdd7ee7 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.32],SizeBytes:17930113,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:09.851: INFO: Logging kubelet events for node bootstrap-e2e-master Jun 26 10:07:09.926: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jun 26 10:07:10.044: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-06-26 10:00:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.044: INFO: Container l7-lb-controller ready: true, restart count 2 Jun 26 10:07:10.044: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.044: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:10.044: INFO: etcd-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.044: INFO: Container etcd-container ready: true, restart count 0 Jun 26 10:07:10.044: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.044: INFO: Container konnectivity-server-container ready: true, restart count 0 Jun 26 10:07:10.044: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.044: INFO: Container kube-apiserver ready: true, restart count 0 Jun 26 10:07:10.044: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-06-26 10:00:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.044: INFO: Container kube-addon-manager ready: true, restart count 0 Jun 26 10:07:10.044: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.044: INFO: Container kube-controller-manager ready: true, restart count 1 Jun 26 10:07:10.044: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-06-26 10:00:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.044: INFO: Container kube-scheduler ready: true, restart count 0 Jun 26 10:07:10.044: INFO: metadata-proxy-v0.1-79zmr started at 2022-06-26 10:01:13 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:10.044: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:10.044: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:10.360: INFO: Latency metrics for node bootstrap-e2e-master Jun 26 10:07:10.360: INFO: Logging node info for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:10.419: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-kv80 8fe21414-4e64-490c-92b5-167dc1e64d0a 9403 0 2022-06-26 10:01:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-kv80 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-kv80 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:06:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:34 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-kv80,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:32 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:33 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:22 +0000 UTC,LastTransitionTime:2022-06-26 10:01:22 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:47 +0000 UTC,LastTransitionTime:2022-06-26 10:01:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.113.50,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-kv80.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b6c246299f5ddd34e63819759303fbd4,SystemUUID:b6c24629-9f5d-dd34-e638-19759303fbd4,BootID:b4e429f5-615d-4b99-b5eb-195153abb687,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:a49993c3325b4bb010e52b8e661ebc62b9d45ebceae6e432d3ee637a4833bae7 registry.k8s.io/sig-storage/snapshot-controller:v6.0.1],SizeBytes:22496839,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:10.419: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:10.504: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:10.589: INFO: affinity-nodeport-timeout-2259x started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:10.589: INFO: kube-proxy-bootstrap-e2e-minion-group-kv80 started at 2022-06-26 10:01:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:10.589: INFO: npd-v0.8.9-vsk67 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:10.589: INFO: dns-test-3c2cd7d3-edb0-4970-a414-32648a9f811e started at 2022-06-26 10:06:43 +0000 UTC (0+3 container statuses recorded) Jun 26 10:07:10.589: INFO: Container jessie-querier ready: true, restart count 0 Jun 26 10:07:10.589: INFO: Container querier ready: true, restart count 0 Jun 26 10:07:10.589: INFO: Container webserver ready: true, restart count 0 Jun 26 10:07:10.589: INFO: pfpod started at 2022-06-26 10:06:51 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:10.589: INFO: Container portforwardtester ready: false, restart count 0 Jun 26 10:07:10.589: INFO: Container readiness ready: false, restart count 0 Jun 26 10:07:10.589: INFO: deployment-5cd6f9c8c9-pm2kh started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:10.589: INFO: metadata-proxy-v0.1-glv9b started at 2022-06-26 10:01:12 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:10.589: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:10.589: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:10.589: INFO: coredns-85bc9d67b-2pcch started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:10.589: INFO: hostexec-bootstrap-e2e-minion-group-kv80-9pdp9 started at 2022-06-26 10:06:11 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:10.589: INFO: l7-default-backend-5f6f9745f9-95c2d started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container default-http-backend ready: true, restart count 0 Jun 26 10:07:10.589: INFO: konnectivity-agent-gh7lr started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:10.589: INFO: deployment-6c468f5898-sqsr7 started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:10.589: INFO: volume-snapshot-controller-0 started at 2022-06-26 10:01:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container volume-snapshot-controller ready: true, restart count 0 Jun 26 10:07:10.589: INFO: execpod-affinityt97jd started at 2022-06-26 10:06:40 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:10.589: INFO: hostexec-bootstrap-e2e-minion-group-kv80-ssdb5 started at 2022-06-26 10:06:08 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:10.589: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:10.955: INFO: Latency metrics for node bootstrap-e2e-minion-group-kv80 Jun 26 10:07:10.955: INFO: Logging node info for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:11.018: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l6r5 bcf9cd6e-4842-45b7-9f21-7de490b4df8c 9626 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l6r5 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l6r5 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6165":"bootstrap-e2e-minion-group-l6r5","csi-mock-csi-mock-volumes-9260":"bootstrap-e2e-minion-group-l6r5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-06-26 10:01:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kube-controller-manager Update v1 2022-06-26 10:07:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} }]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-l6r5,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-06-26 10:06:59 +0000 UTC,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoExecute,TimeAdded:2022-06-26 10:07:04 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:01:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:39 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-06-26 10:04:53 +0000 UTC,LastTransitionTime:2022-06-26 10:06:58 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:35.227.167.115,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l6r5.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5bb667ad496693fbfa6f2dcbfb63cab,SystemUUID:f5bb667a-d496-693f-bfa6-f2dcbfb63cab,BootID:730f0552-4b2a-4a66-b12d-5824a7e7a976,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6165^61fd16d8-f537-11ec-a744-020111734858,DevicePath:,},},Config:nil,},} Jun 26 10:07:11.018: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:11.095: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l6r5 Jun 26 10:07:11.191: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l6r5: error trying to reach service: dial tcp 10.138.0.5:10250: connect: connection refused Jun 26 10:07:11.191: INFO: Logging node info for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:11.241: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-w1f4 aa1194c1-9599-41dd-8e29-c249fef7248e 9523 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-w1f4 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-w1f4 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-06-26 10:04:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-06-26 10:06:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-w1f4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:40 +0000 UTC,LastTransitionTime:2022-06-26 10:01:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.185.251.58,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-w1f4.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38c15cfcea7d87fcfdfb495c46c9f2bd,SystemUUID:38c15cfc-ea7d-87fc-fdfb-495c46c9f2bd,BootID:f547655d-3f0b-4b8f-9e52-ac7560e71bb7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jun 26 10:07:11.241: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:11.313: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:11.392: INFO: test-grpc-0024d73f-6f4d-4e93-a689-31d246e3fd09 started at 2022-06-26 10:05:32 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container etcd ready: true, restart count 0 Jun 26 10:07:11.392: INFO: metadata-proxy-v0.1-lj6mb started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:11.392: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:11.392: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:11.392: INFO: rand-non-local-9thk7 started at 2022-06-26 10:06:48 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container c ready: false, restart count 0 Jun 26 10:07:11.392: INFO: hairpin started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:11.392: INFO: rand-non-local-rcw7v started at 2022-06-26 10:06:45 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container c ready: false, restart count 0 Jun 26 10:07:11.392: INFO: affinity-nodeport-timeout-pf8ht started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:11.392: INFO: verify-service-up-host-exec-pod started at 2022-06-26 10:06:16 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:11.392: INFO: kube-proxy-bootstrap-e2e-minion-group-w1f4 started at 2022-06-26 10:01:19 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:11.392: INFO: konnectivity-agent-8w8st started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:11.392: INFO: service-headless-rfn2p started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:11.392: INFO: pod-projected-secrets-d0859f57-a6b7-4b81-be26-970fd1a684b4 started at 2022-06-26 10:05:58 +0000 UTC (0+3 container statuses recorded) Jun 26 10:07:11.392: INFO: Container creates-volume-test ready: true, restart count 0 Jun 26 10:07:11.392: INFO: Container dels-volume-test ready: true, restart count 0 Jun 26 10:07:11.392: INFO: Container upds-volume-test ready: true, restart count 0 Jun 26 10:07:11.392: INFO: deployment-5cd6f9c8c9-2s82l started at 2022-06-26 10:06:17 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container nginx ready: false, restart count 0 Jun 26 10:07:11.392: INFO: service-headless-toggled-flcct started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:11.392: INFO: npd-v0.8.9-hzvbm started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:11.392: INFO: liveness-1ffb8679-e880-42c5-9594-e7ce6b90aafe started at 2022-06-26 10:04:29 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:11.392: INFO: rand-non-local-gxjbx started at 2022-06-26 10:07:01 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container c ready: false, restart count 0 Jun 26 10:07:11.392: INFO: kube-dns-autoscaler-5477bd659c-hwxn2 started at 2022-06-26 10:06:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container autoscaler ready: true, restart count 0 Jun 26 10:07:11.392: INFO: hostexec-bootstrap-e2e-minion-group-w1f4-rpzgc started at 2022-06-26 10:06:27 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.392: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:11.672: INFO: Latency metrics for node bootstrap-e2e-minion-group-w1f4 Jun 26 10:07:11.672: INFO: Logging node info for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:11.731: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-zvd6 465e1e7d-9f60-42b7-acea-e8cd1dca80e2 9527 0 2022-06-26 10:01:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-zvd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-zvd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2385":"bootstrap-e2e-minion-group-zvd6","csi-hostpath-provisioning-6151":"bootstrap-e2e-minion-group-zvd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-06-26 10:01:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-06-26 10:01:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.4.0/24\"":{}}}} } {node-problem-detector Update v1 2022-06-26 10:06:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-06-26 10:06:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-025/us-west1-b/bootstrap-e2e-minion-group-zvd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-06-26 10:06:42 +0000 UTC,LastTransitionTime:2022-06-26 10:01:40 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-06-26 10:01:34 +0000 UTC,LastTransitionTime:2022-06-26 10:01:34 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-06-26 10:06:57 +0000 UTC,LastTransitionTime:2022-06-26 10:01:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.91.218,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-zvd6.c.k8s-infra-e2e-boskos-025.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aa6080e0da2673fad5141cc4863e32c,SystemUUID:4aa6080e-0da2-673f-ad51-41cc4863e32c,BootID:628a7f46-4bbe-40bc-aa89-4f2b41dd6222,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.4,KubeletVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,KubeProxyVersion:v1.25.0-alpha.1.137+d2c5779dadc9ed,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1.137_d2c5779dadc9ed],SizeBytes:110643255,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e registry.k8s.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:4ea2558eb948b537ad21eb5e66ad299eb82ba21690704569bb9294e326b29dc8 registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.32],SizeBytes:7718495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2385^8d5c4ab5-f537-11ec-ad12-4e9ead5b3a62,DevicePath:,},},Config:nil,},} Jun 26 10:07:11.732: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:11.779: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:11.937: INFO: default started at 2022-06-26 10:06:44 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:11.937: INFO: affinity-nodeport-timeout-4b548 started at 2022-06-26 10:06:31 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Jun 26 10:07:11.937: INFO: private started at 2022-06-26 10:06:42 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:11.937: INFO: metadata-proxy-v0.1-hrd5b started at 2022-06-26 10:01:20 +0000 UTC (0+2 container statuses recorded) Jun 26 10:07:11.937: INFO: Container metadata-proxy ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jun 26 10:07:11.937: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:06:28 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:11.937: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:11.937: INFO: verify-service-up-exec-pod-85m6b started at 2022-06-26 10:06:26 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container agnhost-container ready: true, restart count 0 Jun 26 10:07:11.937: INFO: coredns-85bc9d67b-6grvl started at 2022-06-26 10:05:59 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container coredns ready: true, restart count 0 Jun 26 10:07:11.937: INFO: kube-proxy-bootstrap-e2e-minion-group-zvd6 started at 2022-06-26 10:01:20 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container kube-proxy ready: true, restart count 0 Jun 26 10:07:11.937: INFO: npd-v0.8.9-w26wg started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container node-problem-detector ready: true, restart count 0 Jun 26 10:07:11.937: INFO: konnectivity-agent-thvrv started at 2022-06-26 10:01:34 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container konnectivity-agent ready: true, restart count 0 Jun 26 10:07:11.937: INFO: slave started at 2022-06-26 10:06:39 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:11.937: INFO: inline-volume-tester-nkqft started at 2022-06-26 10:05:49 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container csi-volume-tester ready: true, restart count 0 Jun 26 10:07:11.937: INFO: service-headless-toggled-27ccn started at 2022-06-26 10:05:37 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container service-headless-toggled ready: true, restart count 0 Jun 26 10:07:11.937: INFO: service-headless-lrtx9 started at 2022-06-26 10:05:22 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container service-headless ready: true, restart count 0 Jun 26 10:07:11.937: INFO: master started at 2022-06-26 10:06:35 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container cntr ready: true, restart count 0 Jun 26 10:07:11.937: INFO: adopt-release-brsdt started at 2022-06-26 10:06:21 +0000 UTC (0+1 container statuses recorded) Jun 26 10:07:11.937: INFO: Container c ready: false, restart count 0 Jun 26 10:07:11.937: INFO: csi-hostpathplugin-0 started at 2022-06-26 10:05:43 +0000 UTC (0+7 container statuses recorded) Jun 26 10:07:11.937: INFO: Container csi-attacher ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container csi-provisioner ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container csi-resizer ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container csi-snapshotter ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container hostpath ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container liveness-probe ready: true, restart count 0 Jun 26 10:07:11.937: INFO: Container node-driver-registrar ready: true, restart count 0 Jun 26 10:07:12.284: INFO: Latency metrics for node bootstrap-e2e-minion-group-zvd6 Jun 26 10:07:12.284: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready Jun 26 10:07:12.369: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:14.487: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:16.503: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:18.498: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:20.540: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:22.491: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:24.514: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:26.495: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:28.487: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:30.488: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:32.488: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:34.501: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:36.491: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:38.485: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:40.486: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:42.485: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:44.533: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:46.518: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:48.491: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:50.503: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:52.512: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:54.485: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:56.544: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:07:58.536: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:08:00.477: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-06-26 10:06:59 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC}]. Failure Jun 26 10:08:02.514: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:04.483: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-06-26 10:07:04 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC}]. Failure Jun 26 10:08:06.474: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:08.478: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:10.472: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2022-06-26 10:08:00 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:12.474: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure Jun 26 10:08:14.480: INFO: Condition Ready of node bootstrap-e2e-minion-group-l6r5 is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2022-06-26 10:08:04 +0000 UTC}]. Failure �[1mSTEP�[0m: Destroying namespace "persistent-local-volumes-test-1568" for this suite.
Filter through log files | View test history on testgrid
error during ./hack/ginkgo-e2e.sh --ginkgo.skip=\[Driver:.gcepd\]|\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\] --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true --cluster-ip-range=10.64.0.0/14: exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
Kubernetes e2e suite [sig-api-machinery] API priority and fairness should ensure that requests can be classified by adding FlowSchema and PriorityLevelConfiguration
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing mutating webhooks should work [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing validating webhooks should work [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a mutating webhook should work [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a validating webhook should work [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny custom resource creation, update and deletion [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny pod and configmap creation [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should deny crd creation [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should honor timeout [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should include webhook resources in discovery documents [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate configmap [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with different stored version [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with pruning [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate pod and apply defaults after mutation [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should not be able to mutate or prevent deletion of webhook configuration objects [Conformance]
Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should unconditionally reject operations on fail closed webhook [Conformance]
Kubernetes e2e suite [sig-api-machinery] Aggregator Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert a non homogeneous list of CRs [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert from CR v1 to CR v2 [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin] CustomResourceDefinition Watch watch on custom resource definition objects [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition creating/deleting custom resource definition objects works [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition getting/updating/patching custom resource definition status sub-resource works [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition listing custom resource definition objects works [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] custom resource defaulting for requests and from storage works [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] should include custom resource definition resources in discovery documents [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] removes definition from spec when one version gets changed to not be served [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] updates the published spec when one version gets renamed [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields at the schema root [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields in an embedded object [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD with validation schema [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD without validation schema [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of different groups [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group and version but different kinds [Conformance]
Kubernetes e2e suite [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group but different versions [Conformance]
Kubernetes e2e suite [sig-api-machinery] Discovery Custom resource should have storage version hash
Kubernetes e2e suite [sig-api-machinery] Discovery should accurately determine present and missing resources
Kubernetes e2e suite [sig-api-machinery] Discovery should validate PreferredVersion for each APIGroup [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should delete RS created by deployment when not orphaning [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should delete jobs and pods created by cronjob
Kubernetes e2e suite [sig-api-machinery] Garbage collector should delete pods created by rc when not orphaning [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should keep the rc around until all its pods are deleted if the deleteOptions says so [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should not be blocked by dependency circle [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should not delete dependents that have both valid owner and owner that's waiting for dependents to be deleted [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should orphan RS created by deployment when deleteOptions.PropagationPolicy is Orphan [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should orphan pods created by rc if delete options say so [Conformance]
Kubernetes e2e suite [sig-api-machinery] Garbage collector should orphan pods created by rc if deleteOptions.OrphanDependents is nil
Kubernetes e2e suite [sig-api-machinery] Garbage collector should support cascading deletion of custom resources
Kubernetes e2e suite [sig-api-machinery] Garbage collector should support orphan deletion of custom resources
Kubernetes e2e suite [sig-api-machinery] Generated clientset should create pods, set the deletionTimestamp and deletionGracePeriodSeconds of the pod
Kubernetes e2e suite [sig-api-machinery] Generated clientset should create v1 cronJobs, delete cronJobs, watch cronJobs
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should be able to update and delete ResourceQuota. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a configMap. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a custom resource.
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a persistent volume claim
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a persistent volume claim with a storage class
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a pod. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replica set. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replication controller. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a secret. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a service. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should create a ResourceQuota and ensure its status is promptly calculated. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should verify ResourceQuota with best effort scope. [Conformance]
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should verify ResourceQuota with cross namespace pod affinity scope using scope-selectors.
Kubernetes e2e suite [sig-api-machinery] ResourceQuota should verify ResourceQuota with terminating scopes. [Conformance]
Kubernetes e2e suite [sig-api-machinery] Server request timeout default timeout should be used if the specified timeout in the request URL is 0s
Kubernetes e2e suite [sig-api-machinery] Server request timeout should return HTTP status code 400 if the user specifies an invalid timeout in the request URL
Kubernetes e2e suite [sig-api-machinery] Server request timeout the request should be served with a default timeout if the specified timeout in the request URL exceeds maximum allowed
Kubernetes e2e suite [sig-api-machinery] ServerSideApply should create an applied object if it does not already exist
Kubernetes e2e suite [sig-api-machinery] ServerSideApply should give up ownership of a field if forced applied by a controller
Kubernetes e2e suite [sig-api-machinery] ServerSideApply should ignore conflict errors if force apply is used
Kubernetes e2e suite [sig-api-machinery] ServerSideApply should not remove a field if an owner unsets the field but other managers still have ownership of the field
Kubernetes e2e suite [sig-api-machinery] ServerSideApply should remove a field if it is owned but removed in the apply request
Kubernetes e2e suite [sig-api-machinery] ServerSideApply should work for CRDs
Kubernetes e2e suite [sig-api-machinery] ServerSideApply should work for subresources
Kubernetes e2e suite [sig-api-machinery] Servers with support for API chunking should return chunks of results for list calls
Kubernetes e2e suite [sig-api-machinery] Servers with support for Table transformation should return a 406 for a backend which does not implement metadata [Conformance]
Kubernetes e2e suite [sig-api-machinery] Servers with support for Table transformation should return chunks of table results for list calls
Kubernetes e2e suite [sig-api-machinery] Servers with support for Table transformation should return generic metadata details across all namespaces for nodes
Kubernetes e2e suite [sig-api-machinery] Servers with support for Table transformation should return pod details
Kubernetes e2e suite [sig-api-machinery] Watchers should be able to restart watching from the last resource version observed by the previous watch [Conformance]
Kubernetes e2e suite [sig-api-machinery] Watchers should be able to start watching from a specific resource version [Conformance]
Kubernetes e2e suite [sig-api-machinery] Watchers should observe add, update, and delete watch notifications on configmaps [Conformance]
Kubernetes e2e suite [sig-api-machinery] Watchers should observe an object deletion if it stops meeting the requirements of the selector [Conformance]
Kubernetes e2e suite [sig-api-machinery] Watchers should receive events on concurrent watches in same order [Conformance]
Kubernetes e2e suite [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/json"
Kubernetes e2e suite [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/json,application/vnd.kubernetes.protobuf"
Kubernetes e2e suite [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/vnd.kubernetes.protobuf"
Kubernetes e2e suite [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/vnd.kubernetes.protobuf,application/json"
Kubernetes e2e suite [sig-api-machinery] health handlers should contain necessary checks
Kubernetes e2e suite [sig-api-machinery] server version should find the server version [Conformance]
Kubernetes e2e suite [sig-apps] CronJob should be able to schedule after more than 100 missed schedule
Kubernetes e2e suite [sig-apps] CronJob should delete failed finished jobs with limit of one job
Kubernetes e2e suite [sig-apps] CronJob should delete successful finished jobs with limit of one successful job
Kubernetes e2e suite [sig-apps] CronJob should not emit unexpected warnings
Kubernetes e2e suite [sig-apps] CronJob should remove from active list jobs that have been deleted
Kubernetes e2e suite [sig-apps] CronJob should replace jobs when ReplaceConcurrent [Conformance]
Kubernetes e2e suite [sig-apps] CronJob should schedule multiple jobs concurrently [Conformance]
Kubernetes e2e suite [sig-apps] CronJob should support CronJob API operations [Conformance]
Kubernetes e2e suite [sig-apps] Deployment Deployment should have a working scale subresource [Conformance]
Kubernetes e2e suite [sig-apps] Deployment RecreateDeployment should delete old pods and create new ones [Conformance]
Kubernetes e2e suite [sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]
Kubernetes e2e suite [sig-apps] Deployment deployment reaping should cascade to its replica sets and pods
Kubernetes e2e suite [sig-apps] Deployment deployment should delete old replica sets [Conformance]
Kubernetes e2e suite [sig-apps] Deployment deployment should support proportional scaling [Conformance]
Kubernetes e2e suite [sig-apps] Deployment deployment should support rollover [Conformance]
Kubernetes e2e suite [sig-apps] Deployment iterative rollouts should eventually progress
Kubernetes e2e suite [sig-apps] Deployment should not disrupt a cloud load-balancer's connectivity during rollout
Kubernetes e2e suite [sig-apps] Deployment should run the lifecycle of a Deployment [Conformance]
Kubernetes e2e suite [sig-apps] Deployment should validate Deployment Status endpoints [Conformance]
Kubernetes e2e suite [sig-apps] Deployment test Deployment ReplicaSet orphaning and adoption regarding controllerRef
Kubernetes e2e suite [sig-apps] DisruptionController Listing PodDisruptionBudgets for all namespaces should list and delete a collection of PodDisruptionBudgets [Conformance]
Kubernetes e2e suite [sig-apps] DisruptionController evictions: enough pods, absolute => should allow an eviction
Kubernetes e2e suite [sig-apps] DisruptionController evictions: enough pods, replicaSet, percentage => should allow an eviction
Kubernetes e2e suite [sig-apps] DisruptionController evictions: maxUnavailable allow single eviction, percentage => should allow an eviction
Kubernetes e2e suite [sig-apps] DisruptionController evictions: no PDB => should allow an eviction
Kubernetes e2e suite [sig-apps] DisruptionController evictions: too few pods, absolute => should not allow an eviction
Kubernetes e2e suite [sig-apps] DisruptionController should block an eviction until the PDB is updated to allow it [Conformance]
Kubernetes e2e suite [sig-apps] DisruptionController should create a PodDisruptionBudget [Conformance]
Kubernetes e2e suite [sig-apps] DisruptionController should observe PodDisruptionBudget status updated [Conformance]
Kubernetes e2e suite [sig-apps] DisruptionController should observe that the PodDisruptionBudget status is not updated for unmanaged pods
Kubernetes e2e suite [sig-apps] DisruptionController should update/patch PodDisruptionBudget status [Conformance]
Kubernetes e2e suite [sig-apps] Job should adopt matching orphans and release non-matching pods [Conformance]
Kubernetes e2e suite [sig-apps] Job should apply changes to a job status [Conformance]
Kubernetes e2e suite [sig-apps] Job should create pods for an Indexed job with completion indexes and specified hostname [Conformance]
Kubernetes e2e suite [sig-apps] Job should delete a job [Conformance]
Kubernetes e2e suite [sig-apps] Job should delete pods when suspended
Kubernetes e2e suite [sig-apps] Job should fail to exceed backoffLimit
Kubernetes e2e suite [sig-apps] Job should fail when exceeds active deadline
Kubernetes e2e suite [sig-apps] Job should manage the lifecycle of a job [Conformance]
Kubernetes e2e suite [sig-apps] Job should not create pods when created in suspend state
Kubernetes e2e suite [sig-apps] Job should remove pods when job is deleted
Kubernetes e2e suite [sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]
Kubernetes e2e suite [sig-apps] Job should run a job to completion when tasks sometimes fail and are not locally restarted
Kubernetes e2e suite [sig-apps] Job should run a job to completion when tasks succeed
Kubernetes e2e suite [sig-apps] ReplicaSet Replace and Patch tests [Conformance]
Kubernetes e2e suite [sig-apps] ReplicaSet Replicaset should have a working scale subresource [Conformance]
Kubernetes e2e suite [sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]
Kubernetes e2e suite [sig-apps] ReplicaSet should list and delete a collection of ReplicaSets [Conformance]
Kubernetes e2e suite [sig-apps] ReplicaSet should serve a basic image on each replica with a private image
Kubernetes e2e suite [sig-apps] ReplicaSet should serve a basic image on each replica with a public image [Conformance]
Kubernetes e2e suite [sig-apps] ReplicaSet should surface a failure condition on a common issue like exceeded quota
Kubernetes e2e suite [sig-apps] ReplicaSet should validate Replicaset Status endpoints [Conformance]
Kubernetes e2e suite [sig-apps] ReplicationController should adopt matching pods on creation [Conformance]
Kubernetes e2e suite [sig-apps] ReplicationController should release no longer matching pods [Conformance]
Kubernetes e2e suite [sig-apps] ReplicationController should serve a basic image on each replica with a private image
Kubernetes e2e suite [sig-apps] ReplicationController should serve a basic image on each replica with a public image [Conformance]
Kubernetes e2e suite [sig-apps] ReplicationController should surface a failure condition on a common issue like exceeded quota [Conformance]
Kubernetes e2e suite [sig-apps] ReplicationController should test the lifecycle of a ReplicationController [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet AvailableReplicas should get updated accordingly when MinReadySeconds is enabled
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should have a working scale subresource [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should implement legacy replacement when the update strategy is OnDelete
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should list, patch and delete a collection of StatefulSets [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should validate Statefulset Status endpoints [Conformance]
Kubernetes e2e suite [sig-apps] StatefulSet MinReadySeconds should be honored when enabled
Kubernetes e2e suite [sig-apps] TTLAfterFinished job should be deleted once it finishes after TTL seconds
Kubernetes e2e suite [sig-architecture] Conformance Tests should have at least two untainted nodes [Conformance]
Kubernetes e2e suite [sig-auth] Certificates API [Privileged:ClusterAdmin] should support CSR API operations [Conformance]
Kubernetes e2e suite [sig-auth] Certificates API [Privileged:ClusterAdmin] should support building a client with a CSR
Kubernetes e2e suite [sig-auth] ServiceAccounts ServiceAccountIssuerDiscovery should support OIDC discovery of service account issuer [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts no secret-based service account token should be auto-generated
Kubernetes e2e suite [sig-auth] ServiceAccounts should allow opting out of API token automount [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts should guarantee kube-root-ca.crt exist in any namespace [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts should mount an API token into pods [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts should mount projected service account token [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts should run through the lifecycle of a ServiceAccount [Conformance]
Kubernetes e2e suite [sig-auth] ServiceAccounts should set ownership and permission when RunAsUser or FsGroup is present [LinuxOnly] [NodeFeature:FSGroup]
Kubernetes e2e suite [sig-autoscaling] DNS horizontal autoscaling kube-dns-autoscaler should scale kube-dns pods in both nonfaulty and faulty scenarios
Kubernetes e2e suite [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 should support forwarding over websockets
Kubernetes e2e suite [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects NO client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects a client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects a client request should support a client that connects, sends NO DATA, and disconnects
Kubernetes e2e suite [sig-cli] Kubectl Port forwarding With a server listening on localhost should support forwarding over websockets
Kubernetes e2e suite [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects NO client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects a client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects a client request should support a client that connects, sends NO DATA, and disconnects
Kubernetes e2e suite [sig-cli] Kubectl client Guestbook application should create and stop a working application [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl api-versions should check if v1 is in available api versions [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl apply apply set/view last-applied
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl apply should apply a new configuration to an existing RC
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl apply should reuse port when apply to an existing SVC
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl cluster-info dump should check if cluster-info dump succeeds
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl cluster-info should check if Kubernetes control plane services is included in cluster-info [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl copy should copy a file from a running Pod
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl create quota should create a quota with scopes
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl create quota should create a quota without scopes
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl create quota should reject quota with invalid scopes
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl describe should check if kubectl describe prints relevant information for cronjob
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl describe should check if kubectl describe prints relevant information for rc and pods [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl diff should check if kubectl diff finds a difference for Deployments [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl expose should create services for rc [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl get componentstatuses should get componentstatuses
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl label should update the label on a resource [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl logs should be able to retrieve and filter logs [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl patch should add annotations for pods in rc [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl replace should update a single-container pod's image [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl run pod should create a pod from an image when restart is Never [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl server-side dry-run should check if kubectl can dry-run update Pods [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl validation should create/apply a CR with unknown fields for CRD with no validation schema
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl validation should create/apply a valid CR for CRD with validation schema
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl validation should create/apply a valid CR with arbitrary-extra properties for CRD with partially-specified validation schema
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl validation should detect unknown metadata fields in both the root and embedded object of a CR
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl validation should detect unknown metadata fields of a typed object
Kubernetes e2e suite [sig-cli] Kubectl client Kubectl version should check is all data is printed [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Proxy server should support --unix-socket=/path [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Proxy server should support proxy with --port 0 [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should contain last line of the log
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should handle in-cluster config
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a failing command
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a successful command
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should return command exit codes running a failing command
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should return command exit codes running a successful command
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support exec
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support exec through an HTTP proxy
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support exec through kubectl proxy
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support exec using resource/name
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support inline execution and attach
Kubernetes e2e suite [sig-cli] Kubectl client Simple pod should support port-forward
Kubernetes e2e suite [sig-cli] Kubectl client Update Demo should create and stop a replication controller [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client Update Demo should scale a replication controller [Conformance]
Kubernetes e2e suite [sig-cli] Kubectl client kubectl wait should ignore not found error with --for=delete
Kubernetes e2e suite [sig-instrumentation] Events API should delete a collection of events [Conformance]
Kubernetes e2e suite [sig-instrumentation] Events API should ensure that an event can be fetched, patched, deleted, and listed [Conformance]
Kubernetes e2e suite [sig-instrumentation] Events should delete a collection of events [Conformance]
Kubernetes e2e suite [sig-instrumentation] Events should ensure that an event can be fetched, patched, deleted, and listed [Conformance]
Kubernetes e2e suite [sig-instrumentation] MetricsGrabber should grab all metrics from API server.
Kubernetes e2e suite [sig-instrumentation] MetricsGrabber should grab all metrics from a ControllerManager.
Kubernetes e2e suite [sig-instrumentation] MetricsGrabber should grab all metrics from a Kubelet.
Kubernetes e2e suite [sig-instrumentation] MetricsGrabber should grab all metrics from a Scheduler.
Kubernetes e2e suite [sig-network] CVE-2021-29923 IPv4 Service Type ClusterIP with leading zeros should work interpreted as decimal
Kubernetes e2e suite [sig-network] Conntrack should be able to preserve UDP traffic when initial unready endpoints get ready
Kubernetes e2e suite [sig-network] Conntrack should be able to preserve UDP traffic when server pod cycles for a ClusterIP service
Kubernetes e2e suite [sig-network] Conntrack should be able to preserve UDP traffic when server pod cycles for a NodePort service
Kubernetes e2e suite [sig-network] Conntrack should drop INVALID conntrack entries [Privileged]
Kubernetes e2e suite [sig-network] DNS should provide /etc/hosts entries for the cluster [Conformance]
Kubernetes e2e suite [sig-network] DNS should provide DNS for ExternalName services [Conformance]
Kubernetes e2e suite [sig-network] DNS should provide DNS for pods for Hostname [Conformance]
Kubernetes e2e suite [sig-network] DNS should provide DNS for pods for Subdomain [Conformance]
Kubernetes e2e suite [sig-network] DNS should provide DNS for services [Conformance]
Kubernetes e2e suite [sig-network] DNS should provide DNS for the cluster [Conformance]
Kubernetes e2e suite [sig-network] DNS should provide DNS for the cluster [Provider:GCE]
Kubernetes e2e suite [sig-network] DNS should resolve DNS of partial qualified names for services [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] DNS should resolve DNS of partial qualified names for the cluster [LinuxOnly]
Kubernetes e2e suite [sig-network] DNS should support configurable pod DNS nameservers [Conformance]
Kubernetes e2e suite [sig-network] DNS should support configurable pod resolv.conf
Kubernetes e2e suite [sig-network] EndpointSlice should create Endpoints and EndpointSlices for Pods matching a Service [Conformance]
Kubernetes e2e suite [sig-network] EndpointSlice should create and delete Endpoints and EndpointSlices for a Service with a selector specified [Conformance]
Kubernetes e2e suite [sig-network] EndpointSlice should have Endpoints and EndpointSlices pointing to API Server [Conformance]
Kubernetes e2e suite [sig-network] EndpointSlice should support creating EndpointSlice API operations [Conformance]
Kubernetes e2e suite [sig-network] EndpointSliceMirroring should mirror a custom Endpoints resource through create update and delete [Conformance]
Kubernetes e2e suite [sig-network] Firewall rule control plane should not expose well-known ports
Kubernetes e2e suite [sig-network] Firewall rule should have correct firewall rules for e2e cluster
Kubernetes e2e suite [sig-network] HostPort validates that there is no conflict between pods with same hostPort but different hostIP and protocol [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] Ingress API should support creating Ingress API operations [Conformance]
Kubernetes e2e suite [sig-network] IngressClass API should support creating IngressClass API operations [Conformance]
Kubernetes e2e suite [sig-network] KubeProxy should set TCP CLOSE_WAIT timeout [Privileged]
Kubernetes e2e suite [sig-network] Netpol API should support creating NetworkPolicy API operations
Kubernetes e2e suite [sig-network] NetworkPolicy API should support creating NetworkPolicy API operations
Kubernetes e2e suite [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: http [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: udp [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Pods should function for node-pod communication: http [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Pods should function for node-pod communication: udp [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should be able to handle large requests: http
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should be able to handle large requests: udp
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for client IP based session affinity: http [LinuxOnly]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for client IP based session affinity: udp [LinuxOnly]
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for endpoint-Service: http
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for endpoint-Service: udp
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for multiple endpoint-Services with same selector
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for node-Service: http
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for node-Service: udp
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for pod-Service: http
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for pod-Service: udp
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should function for service endpoints using hostNetwork
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should support basic nodePort: udp functionality
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should update endpoints: http
Kubernetes e2e suite [sig-network] Networking Granular Checks: Services should update endpoints: udp
Kubernetes e2e suite [sig-network] Networking should check kube-proxy urls
Kubernetes e2e suite [sig-network] Networking should provide unchanging, static URL paths for kubernetes api services
Kubernetes e2e suite [sig-network] Proxy version v1 A set of valid responses are returned for both pod and service Proxy [Conformance]
Kubernetes e2e suite [sig-network] Proxy version v1 A set of valid responses are returned for both pod and service ProxyWithPath [Conformance]
Kubernetes e2e suite [sig-network] Proxy version v1 should proxy logs on node using proxy subresource
Kubernetes e2e suite [sig-network] Proxy version v1 should proxy logs on node with explicit kubelet port using proxy subresource
Kubernetes e2e suite [sig-network] Proxy version v1 should proxy through a service and a pod [Conformance]
Kubernetes e2e suite [sig-network] SCTP [LinuxOnly] should allow creating a basic SCTP service with pod and endpoints
Kubernetes e2e suite [sig-network] SCTP [LinuxOnly] should create a ClusterIP Service with SCTP ports
Kubernetes e2e suite [sig-network] SCTP [LinuxOnly] should create a Pod with SCTP HostPort
Kubernetes e2e suite [sig-network] Service endpoints latency should not be very high [Conformance]
Kubernetes e2e suite [sig-network] Services should allow pods to hairpin back to themselves through services
Kubernetes e2e suite [sig-network] Services should be able to change the type from ClusterIP to ExternalName [Conformance]
Kubernetes e2e suite [sig-network] Services should be able to change the type from ExternalName to ClusterIP [Conformance]
Kubernetes e2e suite [sig-network] Services should be able to change the type from ExternalName to NodePort [Conformance]
Kubernetes e2e suite [sig-network] Services should be able to change the type from NodePort to ExternalName [Conformance]
Kubernetes e2e suite [sig-network] Services should be able to connect to terminating and unready endpoints if PublishNotReadyAddresses is true
Kubernetes e2e suite [sig-network] Services should be able to create a functioning NodePort service [Conformance]
Kubernetes e2e suite [sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] Services should be able to switch session affinity for service with type clusterIP [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] Services should be able to up and down services
Kubernetes e2e suite [sig-network] Services should be able to update service type to NodePort listening on same port number but different protocols
Kubernetes e2e suite [sig-network] Services should be possible to connect to a service via ExternalIP when the external IP is not assigned to a node
Kubernetes e2e suite [sig-network] Services should be rejected for evicted pods (no endpoints exist)
Kubernetes e2e suite [sig-network] Services should be rejected when no endpoints exist
Kubernetes e2e suite [sig-network] Services should check NodePort out-of-range
Kubernetes e2e suite [sig-network] Services should complete a service status lifecycle [Conformance]
Kubernetes e2e suite [sig-network] Services should create endpoints for unready pods
Kubernetes e2e suite [sig-network] Services should delete a collection of services [Conformance]
Kubernetes e2e suite [sig-network] Services should find a service from listing all namespaces [Conformance]
Kubernetes e2e suite [sig-network] Services should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] Services should have session affinity timeout work for service with type clusterIP [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] Services should have session affinity work for service with type clusterIP [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-network] Services should implement service.kubernetes.io/headless
Kubernetes e2e suite [sig-network] Services should implement service.kubernetes.io/service-proxy-name
Kubernetes e2e suite [sig-network] Services should not be able to connect to terminating and unready endpoints if PublishNotReadyAddresses is false
Kubernetes e2e suite [sig-network] Services should preserve source pod IP for traffic thru service cluster IP [LinuxOnly]
Kubernetes e2e suite [sig-network] Services should prevent NodePort collisions
Kubernetes e2e suite [sig-network] Services should provide secure master service [Conformance]
Kubernetes e2e suite [sig-network] Services should release NodePorts on delete
Kubernetes e2e suite [sig-network] Services should serve a basic endpoint from pods [Conformance]
Kubernetes e2e suite [sig-network] Services should serve multiport endpoints from pods [Conformance]
Kubernetes e2e suite [sig-network] Services should test the lifecycle of an Endpoint [Conformance]
Kubernetes e2e suite [sig-node] AppArmor load AppArmor profiles can disable an AppArmor profile, using unconfined
Kubernetes e2e suite [sig-node] AppArmor load AppArmor profiles should enforce an AppArmor profile
Kubernetes e2e suite [sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] ConfigMap should fail to create ConfigMap with empty key [Conformance]
Kubernetes e2e suite [sig-node] ConfigMap should run through a ConfigMap lifecycle [Conformance]
Kubernetes e2e suite [sig-node] ConfigMap should update ConfigMap successfully
Kubernetes e2e suite [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart exec hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart http hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop exec hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop http hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test on terminated container should report termination message as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test on terminated container should report termination message from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test on terminated container should report termination message from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test on terminated container should report termination message if TerminationMessagePath is set [NodeConformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test on terminated container should report termination message if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull from private registry with secret [NodeConformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull image [NodeConformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test when running a container with a new image should not be able to pull from private registry without secret [NodeConformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test when running a container with a new image should not be able to pull image from invalid registry [NodeConformance]
Kubernetes e2e suite [sig-node] Container Runtime blackbox test when starting a container that exits should run with the expected status [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Containers should be able to override the image's default arguments (container cmd) [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Containers should be able to override the image's default command (container entrypoint) [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Containers should be able to override the image's default command and arguments [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Containers should use the image defaults if command and args are blank [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Downward API should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Downward API should provide host IP and pod IP as an env var if pod uses host network [LinuxOnly]
Kubernetes e2e suite [sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Downward API should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Ephemeral Containers [NodeFeature:EphemeralContainers] will start an ephemeral container in an existing pod
Kubernetes e2e suite [sig-node] Events should be sent by kubelets and the scheduler about pods scheduling and running
Kubernetes e2e suite [sig-node] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]
Kubernetes e2e suite [sig-node] InitContainer [NodeConformance] should invoke init containers on a RestartNever pod [Conformance]
Kubernetes e2e suite [sig-node] InitContainer [NodeConformance] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]
Kubernetes e2e suite [sig-node] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]
Kubernetes e2e suite [sig-node] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Kubelet when scheduling a busybox command that always fails in a pod should be possible to delete [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Kubelet when scheduling a read only busybox container should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] KubeletManagedEtcHosts should test kubelet managed /etc/hosts file [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Lease lease API should be available [Conformance]
Kubernetes e2e suite [sig-node] NodeLease NodeLease should have OwnerReferences set
Kubernetes e2e suite [sig-node] NodeLease NodeLease the kubelet should create and update a lease in the kube-node-lease namespace
Kubernetes e2e suite [sig-node] NodeLease NodeLease the kubelet should report node status infrequently
Kubernetes e2e suite [sig-node] NodeProblemDetector should run without error
Kubernetes e2e suite [sig-node] PodOSRejection [NodeConformance] Kubelet should reject pod when the node OS doesn't match pod's OS
Kubernetes e2e suite [sig-node] PodTemplates should delete a collection of pod templates [Conformance]
Kubernetes e2e suite [sig-node] PodTemplates should replace a pod template [Conformance]
Kubernetes e2e suite [sig-node] PodTemplates should run the lifecycle of PodTemplates [Conformance]
Kubernetes e2e suite [sig-node] Pods Extended Delete Grace Period should be submitted and removed
Kubernetes e2e suite [sig-node] Pods Extended Pod Container Status should never report container start when an init container fails
Kubernetes e2e suite [sig-node] Pods Extended Pod Container Status should never report success for a pending container
Kubernetes e2e suite [sig-node] Pods Extended Pod Container lifecycle evicted pods should be terminal
Kubernetes e2e suite [sig-node] Pods Extended Pod Container lifecycle should not create extra sandbox if all containers are done
Kubernetes e2e suite [sig-node] Pods Extended Pods Set QOS Class should be set on Pods with matching resource requests and limits for memory and cpu [Conformance]
Kubernetes e2e suite [sig-node] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Pods should be submitted and removed [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Pods should be updated [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Pods should contain environment variables for services [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Pods should delete a collection of pods [Conformance]
Kubernetes e2e suite [sig-node] Pods should get a host IP [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Pods should run through the lifecycle of Pods and PodStatus [Conformance]
Kubernetes e2e suite [sig-node] Pods should support pod readiness gates [NodeConformance]
Kubernetes e2e suite [sig-node] Pods should support remote command execution over websockets [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] PreStop graceful pod terminated should wait until preStop hook completes the process
Kubernetes e2e suite [sig-node] PreStop should call prestop when killing a pod [Conformance]
Kubernetes e2e suite [sig-node] PrivilegedPod [NodeConformance] should enable privileged commands [LinuxOnly]
Kubernetes e2e suite [sig-node] Probing container should *not* be restarted by liveness probe because startup probe delays it
Kubernetes e2e suite [sig-node] Probing container should *not* be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should *not* be restarted with a GRPC liveness probe [NodeConformance]
Kubernetes e2e suite [sig-node] Probing container should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should *not* be restarted with a non-local redirect http liveness probe
Kubernetes e2e suite [sig-node] Probing container should *not* be restarted with a tcp:8080 liveness probe [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should be ready immediately after startupProbe succeeds
Kubernetes e2e suite [sig-node] Probing container should be restarted by liveness probe after startup probe enables it
Kubernetes e2e suite [sig-node] Probing container should be restarted startup probe fails
Kubernetes e2e suite [sig-node] Probing container should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should be restarted with a GRPC liveness probe [NodeConformance]
Kubernetes e2e suite [sig-node] Probing container should be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should be restarted with a failing exec liveness probe that took longer than the timeout
Kubernetes e2e suite [sig-node] Probing container should be restarted with a local redirect http liveness probe
Kubernetes e2e suite [sig-node] Probing container should be restarted with an exec liveness probe with timeout [MinimumKubeletVersion:1.20] [NodeConformance]
Kubernetes e2e suite [sig-node] Probing container should have monotonically increasing restart count [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container should mark readiness on pods to false and disable liveness probes while pod is in progress of terminating
Kubernetes e2e suite [sig-node] Probing container should mark readiness on pods to false while pod is in progress of terminating when a pod has a readiness probe
Kubernetes e2e suite [sig-node] Probing container should not be ready with an exec readiness probe timeout [MinimumKubeletVersion:1.20] [NodeConformance]
Kubernetes e2e suite [sig-node] Probing container with readiness probe should not be ready before initial delay and never restart [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Probing container with readiness probe that fails should never be ready and never restart [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] RuntimeClass should support RuntimeClasses API operations [Conformance]
Kubernetes e2e suite [sig-node] RuntimeClass should reject a Pod requesting a RuntimeClass with an unconfigured handler [NodeFeature:RuntimeHandler]
Kubernetes e2e suite [sig-node] RuntimeClass should reject a Pod requesting a RuntimeClass with conflicting node selector
Kubernetes e2e suite [sig-node] RuntimeClass should reject a Pod requesting a deleted RuntimeClass [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] RuntimeClass should reject a Pod requesting a non-existent RuntimeClass [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler]
Kubernetes e2e suite [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with scheduling without taints
Kubernetes e2e suite [sig-node] RuntimeClass should schedule a Pod requesting a RuntimeClass and initialize its Overhead [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] RuntimeClass should schedule a Pod requesting a RuntimeClass without PodOverhead [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] SSH should SSH to all nodes and run commands
Kubernetes e2e suite [sig-node] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Secrets should be consumable via the environment [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Secrets should fail to create secret due to empty secret key [Conformance]
Kubernetes e2e suite [sig-node] Secrets should patch a secret [Conformance]
Kubernetes e2e suite [sig-node] Security Context When creating a container with runAsNonRoot should not run with an explicit root user ID [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context When creating a container with runAsNonRoot should not run without a specified user ID
Kubernetes e2e suite [sig-node] Security Context When creating a container with runAsNonRoot should run with an explicit non-root user ID [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context When creating a container with runAsNonRoot should run with an image specified user ID
Kubernetes e2e suite [sig-node] Security Context When creating a container with runAsUser should run the container with uid 0 [LinuxOnly] [NodeConformance]
Kubernetes e2e suite [sig-node] Security Context When creating a container with runAsUser should run the container with uid 65534 [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Security Context When creating a pod with privileged should run the container as privileged when true [LinuxOnly] [NodeFeature:HostAccess]
Kubernetes e2e suite [sig-node] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Security Context When creating a pod with readOnlyRootFilesystem should run the container with readonly rootfs when readOnlyRootFilesystem=true [LinuxOnly] [NodeConformance]
Kubernetes e2e suite [sig-node] Security Context When creating a pod with readOnlyRootFilesystem should run the container with writable rootfs when readOnlyRootFilesystem=false [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Security Context should support container.SecurityContext.RunAsUser And container.SecurityContext.RunAsGroup [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-node] Security Context should support container.SecurityContext.RunAsUser [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context should support pod.Spec.SecurityContext.RunAsUser And pod.Spec.SecurityContext.RunAsGroup [LinuxOnly] [Conformance]
Kubernetes e2e suite [sig-node] Security Context should support pod.Spec.SecurityContext.RunAsUser [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context should support pod.Spec.SecurityContext.SupplementalGroups [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context should support seccomp default which is unconfined [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context should support seccomp runtime/default [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context should support seccomp unconfined on the container [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context should support seccomp unconfined on the pod [LinuxOnly]
Kubernetes e2e suite [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should allow privilege escalation when not explicitly set and uid != 0 [LinuxOnly] [NodeConformance]
Kubernetes e2e suite [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should allow privilege escalation when true [LinuxOnly] [NodeConformance]
Kubernetes e2e suite [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Sysctls [LinuxOnly] [NodeConformance] should not launch unsafe, but not explicitly enabled sysctls on the node [MinimumKubeletVersion:1.21]
Kubernetes e2e suite [sig-node] Sysctls [LinuxOnly] [NodeConformance] should reject invalid sysctls [MinimumKubeletVersion:1.21] [Conformance]
Kubernetes e2e suite [sig-node] Sysctls [LinuxOnly] [NodeConformance] should support sysctls [MinimumKubeletVersion:1.21] [Conformance]
Kubernetes e2e suite [sig-node] Variable Expansion should allow composing env vars into new env vars [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Variable Expansion should allow substituting values in a container's command [NodeConformance] [Conformance]
Kubernetes e2e suite [sig-node] Variable Expansion should allow substituting values in a volume subpath [Conformance]
Kubernetes e2e suite [sig-node] crictl should be able to run crictl on the node
Kubernetes e2e suite [sig-node] kubelet Clean up pods on node kubelet should be able to delete 10 pods per node in 1m0s.
Kubernetes e2e suite [sig-scheduling] LimitRange should create a LimitRange with defaults and ensure pod has those defaults applied. [Conformance]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read-only inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] provisioning should mount multiple PV pointing to the same storage on the same node
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] volumes should store data
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should verify that all csinodes have volume limits
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read/write inline ephemeral volume
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support multiple inline ephemeral volumes
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support two pods which have the same volume definition
Kubernetes e2e suite [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (imme