PR | my-git9: [UT] add test for pkg/securitycontext/util.go |
Result | FAILURE |
Tests | 90 failed / 868 succeeded |
Started | |
Elapsed | 1h30m |
Revision | |
Builder | ae2e729d-c60a-11ed-86ed-9e80c8e2f64d |
Refs |
master:fe91bc25 116737:7e048899 |
control_plane_node_os_image | ubuntu-2204-jammy-v20220712a |
infra-commit | 4c0e37b4a |
job-version | v1.27.0-beta.0.24+a14e71dad7e3b9 |
kubetest-version | v20230222-b5208facd4 |
repo | k8s.io/kubernetes |
repo-commit | a14e71dad7e3b976d0d643cbec5a01ece82c79be |
repos | {u'k8s.io/kubernetes': u'master:fe91bc257b505eb6057eb50b9c550a7c63e9fb91,116737:7e0488995efb153d7ff667a2e7e22b266f206344', u'k8s.io/release': u'master'} |
revision | v1.27.0-beta.0.24+a14e71dad7e3b9 |
worker_node_os_image | ubuntu-2204-jammy-v20220712a |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\slisting\smutating\swebhooks\sshould\swork\s\[Conformance\]$'
[FAILED] Waiting for configMap in namespace webhook-7339 to be mutated: Internal error occurred: failed calling webhook "adding-configmap-data-stage-1.k8s.io": failed to call webhook: Post "https://e2e-test-webhook.webhook-7339.svc:8443/mutating-configmaps?timeout=10s": context deadline exceeded In [It] at: test/e2e/apimachinery/webhook.go:686 @ 03/19/23 04:44:05.807from junit_01.xml
> Enter [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - set up framework | framework.go:191 @ 03/19/23 04:43:39.983 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/19/23 04:43:39.983 Mar 19 04:43:39.983: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook - test/e2e/framework/framework.go:250 @ 03/19/23 04:43:39.984 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/19/23 04:43:40.234 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/19/23 04:43:40.361 < Exit [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - set up framework | framework.go:191 @ 03/19/23 04:43:40.458 (475ms) > Enter [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:43:40.458 < Exit [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:43:40.458 (0s) > Enter [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/apimachinery/webhook.go:91 @ 03/19/23 04:43:40.458 STEP: Setting up server cert - test/e2e/apimachinery/webhook.go:99 @ 03/19/23 04:43:40.75 STEP: Create role binding to let webhook read extension-apiserver-authentication - test/e2e/apimachinery/webhook.go:709 @ 03/19/23 04:43:41.23 STEP: Deploying the webhook pod - test/e2e/apimachinery/webhook.go:741 @ 03/19/23 04:43:41.284 STEP: Wait for the deployment to be ready - test/e2e/apimachinery/webhook.go:811 @ 03/19/23 04:43:41.406 Mar 19 04:43:41.591: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set STEP: Deploying the webhook service - test/e2e/apimachinery/webhook.go:817 @ 03/19/23 04:43:43.805 STEP: Verifying the service has paired with the endpoint - test/e2e/apimachinery/webhook.go:840 @ 03/19/23 04:43:43.908 Mar 19 04:43:44.909: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 < Exit [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/apimachinery/webhook.go:91 @ 03/19/23 04:43:44.977 (4.519s) > Enter [It] listing mutating webhooks should work [Conformance] - test/e2e/apimachinery/webhook.go:645 @ 03/19/23 04:43:44.977 STEP: Listing all of the created validation webhooks - test/e2e/apimachinery/webhook.go:665 @ 03/19/23 04:43:45.519 STEP: Creating a configMap that should be mutated - test/e2e/apimachinery/webhook.go:674 @ 03/19/23 04:43:55.759 Mar 19 04:44:05.807: INFO: Unexpected error: Waiting for configMap in namespace webhook-7339 to be mutated: <*errors.StatusError | 0xc0049c90e0>: Internal error occurred: failed calling webhook "adding-configmap-data-stage-1.k8s.io": failed to call webhook: Post "https://e2e-test-webhook.webhook-7339.svc:8443/mutating-configmaps?timeout=10s": context deadline exceeded { ErrStatus: code: 500 details: causes: - message: 'failed calling webhook "adding-configmap-data-stage-1.k8s.io": failed to call webhook: Post "https://e2e-test-webhook.webhook-7339.svc:8443/mutating-configmaps?timeout=10s": context deadline exceeded' message: 'Internal error occurred: failed calling webhook "adding-configmap-data-stage-1.k8s.io": failed to call webhook: Post "https://e2e-test-webhook.webhook-7339.svc:8443/mutating-configmaps?timeout=10s": context deadline exceeded' metadata: {} reason: InternalError status: Failure, } [FAILED] Waiting for configMap in namespace webhook-7339 to be mutated: Internal error occurred: failed calling webhook "adding-configmap-data-stage-1.k8s.io": failed to call webhook: Post "https://e2e-test-webhook.webhook-7339.svc:8443/mutating-configmaps?timeout=10s": context deadline exceeded In [It] at: test/e2e/apimachinery/webhook.go:686 @ 03/19/23 04:44:05.807 < Exit [It] listing mutating webhooks should work [Conformance] - test/e2e/apimachinery/webhook.go:645 @ 03/19/23 04:44:05.807 (20.83s) > Enter [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:44:05.807 Mar 19 04:44:05.807: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:44:05.927 (120ms) > Enter [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/apimachinery/webhook.go:106 @ 03/19/23 04:44:05.927 < Exit [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/apimachinery/webhook.go:106 @ 03/19/23 04:44:06.14 (212ms) > Enter [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:44:06.14 < Exit [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:44:06.14 (0s) > Enter [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - dump namespaces | framework.go:209 @ 03/19/23 04:44:06.14 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:44:06.14 STEP: Collecting events from namespace "webhook-7339". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:44:06.14 STEP: Found 7 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:44:06.181 Mar 19 04:44:06.181: INFO: At 2023-03-19 04:43:41 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-7497495989 to 1 Mar 19 04:44:06.181: INFO: At 2023-03-19 04:43:41 +0000 UTC - event for sample-webhook-deployment-7497495989: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-7497495989-qltnz Mar 19 04:44:06.181: INFO: At 2023-03-19 04:43:41 +0000 UTC - event for sample-webhook-deployment-7497495989-qltnz: {default-scheduler } Scheduled: Successfully assigned webhook-7339/sample-webhook-deployment-7497495989-qltnz to e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:44:06.181: INFO: At 2023-03-19 04:43:43 +0000 UTC - event for sample-webhook-deployment-7497495989-qltnz: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 19 04:44:06.181: INFO: At 2023-03-19 04:43:43 +0000 UTC - event for sample-webhook-deployment-7497495989-qltnz: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Created: Created container sample-webhook Mar 19 04:44:06.181: INFO: At 2023-03-19 04:43:43 +0000 UTC - event for sample-webhook-deployment-7497495989-qltnz: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Started: Started container sample-webhook Mar 19 04:44:06.181: INFO: At 2023-03-19 04:44:06 +0000 UTC - event for sample-webhook-deployment-7497495989-qltnz: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Killing: Stopping container sample-webhook Mar 19 04:44:06.223: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:44:06.223: INFO: Mar 19 04:44:06.275: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:44:06.318: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 28195 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:40:10 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:44:06.319: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:44:06.364: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:44:06.427: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.427: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:44:06.427: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.427: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:44:06.427: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.427: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:44:06.427: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.427: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:44:06.427: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.427: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:44:06.427: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.427: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:44:06.427: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.427: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:44:06.427: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.427: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:44:06.427: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:44:06.427: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:44:06.427: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:44:06.695: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:44:06.695: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:44:06.748: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 35688 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-1287":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-03-19 04:43:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:43:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2023-03-19 04:43:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:43:50 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:43:26 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:43:26 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:43:26 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:43:26 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volumemode-1287^95c6a705-c610-11ed-b2f1-1a71a71b392b,DevicePath:,},},Config:nil,},} Mar 19 04:44:06.749: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:44:06.794: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:44:06.892: INFO: netserver-0 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:06.892: INFO: test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:06.892: INFO: pod-prestop-hook-250bb4f6-b07b-4446-85fb-c865fc66bb49 started at 2023-03-19 04:44:02 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container nginx ready: true, restart count 0 Mar 19 04:44:06.892: INFO: pod-update-activedeadlineseconds-3f8030be-3f0c-4289-838b-5b642ad0947d started at 2023-03-19 04:43:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container pause ready: false, restart count 0 Mar 19 04:44:06.892: INFO: netserver-0 started at 2023-03-19 04:40:47 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:06.892: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:44:06.892: INFO: affinity-nodeport-transition-hlg9n started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:44:06.892: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:44:06.892: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:44:06.892: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:44:06.892: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:43:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:44:06.892: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:43:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:44:06.892: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-nkkfw started at 2023-03-19 04:43:28 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:06.892: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:43:23 +0000 UTC (0+7 container statuses recorded) Mar 19 04:44:06.892: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:44:06.892: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:06.892: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:44:06.892: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:44:06.892: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:44:06.892: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:44:06.892: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:44:06.892: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:44:06.892: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:44:06.892: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:44:06.892: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:44:06.892: INFO: busybox-82c974fa-a1fc-45e6-887c-60a8238581f0 started at 2023-03-19 04:42:19 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:06.892: INFO: pod-44a0649a-616b-4715-b751-52777a69fde8 started at 2023-03-19 04:43:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:44:06.892: INFO: liveness-120b4652-a4a2-4301-9bb3-8c2d68de5750 started at 2023-03-19 04:44:04 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:06.892: INFO: csi-mockplugin-0 started at 2023-03-19 04:43:48 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:06.892: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:06.892: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:06.892: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:44:06.892: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:06.892: INFO: host-test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:06.892: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container httpd ready: true, restart count 0 Mar 19 04:44:06.892: INFO: test-container-pod started at 2023-03-19 04:40:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:06.892: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:44:06.892: INFO: nodeport-update-service-c2bvf started at 2023-03-19 04:42:36 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:06.892: INFO: Container nodeport-update-service ready: true, restart count 0 Mar 19 04:44:07.245: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:44:07.245: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:44:07.297: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 36136 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7234":"e2e-c595d7501c-674b9-minion-group-kd0v","csi-mock-csi-mock-volumes-expansion-2079":"csi-mock-csi-mock-volumes-expansion-2079"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:43:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-19 04:44:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-19 04:44:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:43:52 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2079^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7234^ac0b81cd-c610-11ed-8348-ca551e6b9fe0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2079^4,DevicePath:,},},Config:nil,},} Mar 19 04:44:07.297: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:44:07.347: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:44:07.417: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-kd0v started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:44:07.417: INFO: netserver-1 started at 2023-03-19 04:40:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:07.417: INFO: npd-v0.8.9-xn47l started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:44:07.417: INFO: csi-mockplugin-0 started at 2023-03-19 04:40:03 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:07.417: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container csi-provisioner ready: false, restart count 4 Mar 19 04:44:07.417: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:07.417: INFO: inline-volume-tester2-bdwxn started at 2023-03-19 04:37:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:44:07.417: INFO: inline-volume-tester-mrxxq started at 2023-03-19 04:44:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:44:07.417: INFO: netserver-1 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:07.417: INFO: csi-mockplugin-0 started at 2023-03-19 04:43:56 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:07.417: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:07.417: INFO: metadata-proxy-v0.1-bxcx5 started at 2023-03-19 04:28:34 +0000 UTC (0+2 container statuses recorded) Mar 19 04:44:07.417: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:44:07.417: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:44:00 +0000 UTC (0+7 container statuses recorded) Mar 19 04:44:07.417: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:44:07.417: INFO: konnectivity-agent-n8mzc started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:44:07.417: INFO: csi-mockplugin-0 started at 2023-03-19 04:42:12 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:07.417: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container driver-registrar ready: false, restart count 1 Mar 19 04:44:07.417: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:07.417: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:43:56 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:44:07.417: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-vkrzh started at 2023-03-19 04:44:06 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container agnhost-container ready: false, restart count 0 Mar 19 04:44:07.417: INFO: pod-ephm-test-projected-b54h started at 2023-03-19 04:42:05 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container test-container-subpath-projected-b54h ready: false, restart count 0 Mar 19 04:44:07.417: INFO: netserver-1 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:07.417: INFO: coredns-8f5847b64-rzgwn started at 2023-03-19 04:28:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container coredns ready: true, restart count 0 Mar 19 04:44:07.417: INFO: affinity-nodeport-transition-q8wrj started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:44:07.417: INFO: pvc-volume-tester-m9fn8 started at 2023-03-19 04:41:55 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container volume-tester ready: false, restart count 0 Mar 19 04:44:07.417: INFO: execpods68sv started at 2023-03-19 04:42:40 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:07.417: INFO: csi-mockplugin-0 started at 2023-03-19 04:41:11 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:07.417: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:44:07.417: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:07.417: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:41:11 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.417: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:44:07.753: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:44:07.753: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:44:07.798: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-rx1t 81031ff0-6ac7-4503-8384-dada37cf30f8 35792 0 2023-03-19 04:28:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-rx1t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-rx1t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:39:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-19 04:41:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2023-03-19 04:43:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-rx1t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:43:54 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.10.228,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:515db57784a9c6bd89ce17868c72021b,SystemUUID:515db577-84a9-c6bd-89ce-17868c72021b,BootID:744f3d9d-8dea-4311-872e-96785d8e8169,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:44:07.799: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:44:07.843: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:44:07.910: INFO: netserver-2 started at 2023-03-19 04:40:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:07.910: INFO: run-test started at 2023-03-19 04:44:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container run-test ready: true, restart count 0 Mar 19 04:44:07.910: INFO: nodeport-update-service-fd9jp started at 2023-03-19 04:42:36 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container nodeport-update-service ready: true, restart count 0 Mar 19 04:44:07.910: INFO: netserver-2 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:07.910: INFO: pod-configmaps-0c265eff-2f37-4e3e-87c1-88e3a27bfe90 started at 2023-03-19 04:43:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:07.910: INFO: httpd started at 2023-03-19 04:43:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container httpd ready: true, restart count 0 Mar 19 04:44:07.910: INFO: test-container-pod started at 2023-03-19 04:39:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:07.910: INFO: affinity-nodeport-transition-ffkwt started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:44:07.910: INFO: execpod-affinityxk5sg started at 2023-03-19 04:42:37 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:07.910: INFO: csi-mockplugin-0 started at 2023-03-19 04:40:03 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:07.910: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:07.910: INFO: Container csi-provisioner ready: false, restart count 4 Mar 19 04:44:07.910: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:44:07.910: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:07.910: INFO: netserver-2 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:07.910: INFO: pod1 started at 2023-03-19 04:44:04 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:07.910: INFO: kube-dns-autoscaler-7b444c59c9-28g2s started at 2023-03-19 04:31:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container autoscaler ready: true, restart count 0 Mar 19 04:44:07.910: INFO: npd-v0.8.9-j2c8h started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:44:07.910: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-rx1t started at 2023-03-19 04:28:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:44:07.910: INFO: nfs-client started at 2023-03-19 04:43:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container nfs-client ready: true, restart count 0 Mar 19 04:44:07.910: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-6jdp4 started at 2023-03-19 04:43:24 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:07.910: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:40:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container csi-attacher ready: false, restart count 4 Mar 19 04:44:07.910: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:40:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container csi-resizer ready: false, restart count 4 Mar 19 04:44:07.910: INFO: volume-snapshot-controller-0 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container volume-snapshot-controller ready: true, restart count 0 Mar 19 04:44:07.910: INFO: pod-4be3ddcc-6828-4d57-8a2b-94e1f17321ae started at 2023-03-19 04:43:28 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:44:07.910: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-znbq8 started at 2023-03-19 04:43:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:07.910: INFO: metadata-proxy-v0.1-tlkct started at 2023-03-19 04:28:35 +0000 UTC (0+2 container statuses recorded) Mar 19 04:44:07.910: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:44:07.910: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:44:07.910: INFO: hairpin started at 2023-03-19 04:43:26 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:07.910: INFO: nfs-server started at 2023-03-19 04:43:47 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container nfs-server ready: true, restart count 0 Mar 19 04:44:07.910: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-rxjp6 started at 2023-03-19 04:43:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:07.910: INFO: coredns-8f5847b64-cb89d started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container coredns ready: true, restart count 0 Mar 19 04:44:07.910: INFO: l7-default-backend-856d874f49-9wsfv started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container default-http-backend ready: true, restart count 0 Mar 19 04:44:07.910: INFO: konnectivity-agent-m2cxq started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:07.910: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:44:08.196: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-rx1t STEP: Collecting events from namespace "webhook-markers-136". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:44:08.196 STEP: Found 0 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:44:08.237 Mar 19 04:44:08.305: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:44:08.305: INFO: Mar 19 04:44:08.353: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:44:08.397: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 28195 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:40:10 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:44:08.397: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:44:08.444: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:44:08.515: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.515: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:44:08.515: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.515: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:44:08.515: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.515: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:44:08.515: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.515: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:44:08.515: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.515: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:44:08.515: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:44:08.515: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:44:08.515: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:44:08.515: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.515: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:44:08.515: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.515: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:44:08.515: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.515: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:44:08.766: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:44:08.766: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:44:08.812: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 35688 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-1287":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-03-19 04:43:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:43:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2023-03-19 04:43:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:43:50 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:43:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:43:26 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:43:26 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:43:26 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:43:26 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volumemode-1287^95c6a705-c610-11ed-b2f1-1a71a71b392b,DevicePath:,},},Config:nil,},} Mar 19 04:44:08.812: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:44:08.861: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:44:08.955: INFO: host-test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:08.955: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container httpd ready: true, restart count 0 Mar 19 04:44:08.955: INFO: test-container-pod started at 2023-03-19 04:40:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:08.955: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:44:08.955: INFO: nodeport-update-service-c2bvf started at 2023-03-19 04:42:36 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container nodeport-update-service ready: true, restart count 0 Mar 19 04:44:08.955: INFO: netserver-0 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:08.955: INFO: test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:08.955: INFO: pod-prestop-hook-250bb4f6-b07b-4446-85fb-c865fc66bb49 started at 2023-03-19 04:44:02 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container nginx ready: true, restart count 0 Mar 19 04:44:08.955: INFO: pod-update-activedeadlineseconds-3f8030be-3f0c-4289-838b-5b642ad0947d started at 2023-03-19 04:43:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container pause ready: false, restart count 0 Mar 19 04:44:08.955: INFO: netserver-0 started at 2023-03-19 04:40:47 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:08.955: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:44:08.955: INFO: affinity-nodeport-transition-hlg9n started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:44:08.955: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:44:08.955: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:44:08.955: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:44:08.955: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:43:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:44:08.955: INFO: execpod9v74l started at 2023-03-19 04:44:06 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:08.955: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:43:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:44:08.955: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-nkkfw started at 2023-03-19 04:43:28 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:08.955: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:43:23 +0000 UTC (0+7 container statuses recorded) Mar 19 04:44:08.955: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:44:08.955: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:08.955: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:44:08.955: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:44:08.955: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:44:08.955: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:44:08.955: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:44:08.955: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:44:08.955: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:44:08.955: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:44:08.955: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:44:08.955: INFO: busybox-82c974fa-a1fc-45e6-887c-60a8238581f0 started at 2023-03-19 04:42:19 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:08.955: INFO: pod-44a0649a-616b-4715-b751-52777a69fde8 started at 2023-03-19 04:43:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:44:08.955: INFO: liveness-120b4652-a4a2-4301-9bb3-8c2d68de5750 started at 2023-03-19 04:44:04 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:08.955: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:08.955: INFO: csi-mockplugin-0 started at 2023-03-19 04:43:48 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:08.955: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:08.955: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:08.955: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:44:08.955: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:09.299: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:44:09.300: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:44:09.345: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 36341 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7234":"e2e-c595d7501c-674b9-minion-group-kd0v","csi-mock-csi-mock-volumes-expansion-2079":"csi-mock-csi-mock-volumes-expansion-2079"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:43:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:44:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:44:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:43:52 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:43:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:44:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:44:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:44:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:44:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7234^ac0b81cd-c610-11ed-8348-ca551e6b9fe0 kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2079^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7234^ac0b81cd-c610-11ed-8348-ca551e6b9fe0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2079^4,DevicePath:,},},Config:nil,},} Mar 19 04:44:09.345: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:44:09.457: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:44:09.641: INFO: inline-volume-tester2-bdwxn started at 2023-03-19 04:37:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:44:09.642: INFO: netserver-1 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:09.642: INFO: inline-volume-tester-mrxxq started at 2023-03-19 04:44:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:44:09.642: INFO: csi-mockplugin-0 started at 2023-03-19 04:43:56 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:09.642: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:09.642: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:44:00 +0000 UTC (0+7 container statuses recorded) Mar 19 04:44:09.642: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:44:09.642: INFO: metadata-proxy-v0.1-bxcx5 started at 2023-03-19 04:28:34 +0000 UTC (0+2 container statuses recorded) Mar 19 04:44:09.642: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:44:09.642: INFO: konnectivity-agent-n8mzc started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:44:09.642: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:43:56 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:44:09.642: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-vkrzh started at 2023-03-19 04:44:06 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:09.642: INFO: csi-mockplugin-0 started at 2023-03-19 04:42:12 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:09.642: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container driver-registrar ready: false, restart count 1 Mar 19 04:44:09.642: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:09.642: INFO: netserver-1 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:09.642: INFO: pod-ephm-test-projected-b54h started at 2023-03-19 04:42:05 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container test-container-subpath-projected-b54h ready: false, restart count 0 Mar 19 04:44:09.642: INFO: coredns-8f5847b64-rzgwn started at 2023-03-19 04:28:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container coredns ready: true, restart count 0 Mar 19 04:44:09.642: INFO: affinity-nodeport-transition-q8wrj started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:44:09.642: INFO: pvc-volume-tester-m9fn8 started at 2023-03-19 04:41:55 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container volume-tester ready: false, restart count 0 Mar 19 04:44:09.642: INFO: execpods68sv started at 2023-03-19 04:42:40 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:09.642: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:41:11 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:44:09.642: INFO: csi-mockplugin-0 started at 2023-03-19 04:41:11 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:09.642: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:09.642: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-kd0v started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:44:09.642: INFO: netserver-1 started at 2023-03-19 04:40:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:09.642: INFO: npd-v0.8.9-xn47l started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:09.642: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:44:09.642: INFO: csi-mockplugin-0 started at 2023-03-19 04:40:03 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:09.642: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container csi-provisioner ready: false, restart count 4 Mar 19 04:44:09.642: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:44:09.642: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:10.048: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:44:10.048: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:44:10.091: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-rx1t 81031ff0-6ac7-4503-8384-dada37cf30f8 35792 0 2023-03-19 04:28:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-rx1t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-rx1t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:39:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-19 04:41:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2023-03-19 04:43:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-rx1t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:43:54 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:43:54 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.10.228,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:515db57784a9c6bd89ce17868c72021b,SystemUUID:515db577-84a9-c6bd-89ce-17868c72021b,BootID:744f3d9d-8dea-4311-872e-96785d8e8169,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:44:10.092: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:44:10.135: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:44:10.195: INFO: kube-dns-autoscaler-7b444c59c9-28g2s started at 2023-03-19 04:31:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.195: INFO: Container autoscaler ready: true, restart count 0 Mar 19 04:44:10.195: INFO: npd-v0.8.9-j2c8h started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.195: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:44:10.195: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-rx1t started at 2023-03-19 04:28:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.195: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:44:10.195: INFO: nfs-client started at 2023-03-19 04:43:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.195: INFO: Container nfs-client ready: true, restart count 0 Mar 19 04:44:10.195: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-6jdp4 started at 2023-03-19 04:43:24 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.195: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:10.195: INFO: volume-snapshot-controller-0 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.195: INFO: Container volume-snapshot-controller ready: true, restart count 0 Mar 19 04:44:10.195: INFO: pod-4be3ddcc-6828-4d57-8a2b-94e1f17321ae started at 2023-03-19 04:43:28 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.195: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:44:10.195: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:40:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.195: INFO: Container csi-attacher ready: false, restart count 4 Mar 19 04:44:10.195: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:40:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.195: INFO: Container csi-resizer ready: false, restart count 4 Mar 19 04:44:10.195: INFO: metadata-proxy-v0.1-tlkct started at 2023-03-19 04:28:35 +0000 UTC (0+2 container statuses recorded) Mar 19 04:44:10.195: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:44:10.195: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:44:10.195: INFO: nfs-server started at 2023-03-19 04:43:47 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container nfs-server ready: true, restart count 0 Mar 19 04:44:10.196: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-znbq8 started at 2023-03-19 04:43:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:10.196: INFO: metadata-volume-300d1669-01d5-4194-b3e2-a038f48c5d66 started at 2023-03-19 04:44:08 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container client-container ready: true, restart count 0 Mar 19 04:44:10.196: INFO: coredns-8f5847b64-cb89d started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container coredns ready: true, restart count 0 Mar 19 04:44:10.196: INFO: l7-default-backend-856d874f49-9wsfv started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container default-http-backend ready: true, restart count 0 Mar 19 04:44:10.196: INFO: konnectivity-agent-m2cxq started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:44:10.196: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-rxjp6 started at 2023-03-19 04:43:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:10.196: INFO: netserver-2 started at 2023-03-19 04:40:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:10.196: INFO: run-test started at 2023-03-19 04:44:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container run-test ready: true, restart count 0 Mar 19 04:44:10.196: INFO: nodeport-update-service-fd9jp started at 2023-03-19 04:42:36 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container nodeport-update-service ready: true, restart count 0 Mar 19 04:44:10.196: INFO: netserver-2 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:10.196: INFO: pod-configmaps-0c265eff-2f37-4e3e-87c1-88e3a27bfe90 started at 2023-03-19 04:43:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:10.196: INFO: test-container-pod started at 2023-03-19 04:39:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:10.196: INFO: affinity-nodeport-transition-ffkwt started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:44:10.196: INFO: execpod-affinityxk5sg started at 2023-03-19 04:42:37 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:10.196: INFO: httpd started at 2023-03-19 04:43:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container httpd ready: true, restart count 0 Mar 19 04:44:10.196: INFO: csi-mockplugin-0 started at 2023-03-19 04:40:03 +0000 UTC (0+4 container statuses recorded) Mar 19 04:44:10.196: INFO: Container busybox ready: true, restart count 0 Mar 19 04:44:10.196: INFO: Container csi-provisioner ready: false, restart count 4 Mar 19 04:44:10.196: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:44:10.196: INFO: Container mock ready: true, restart count 0 Mar 19 04:44:10.196: INFO: netserver-2 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container webserver ready: true, restart count 0 Mar 19 04:44:10.196: INFO: pod1 started at 2023-03-19 04:44:04 +0000 UTC (0+1 container statuses recorded) Mar 19 04:44:10.196: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:44:10.473: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-rx1t END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:44:10.473 (4.334s) < Exit [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - dump namespaces | framework.go:209 @ 03/19/23 04:44:10.473 (4.334s) > Enter [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - tear down framework | framework.go:206 @ 03/19/23 04:44:10.473 STEP: Destroying namespace "webhook-7339" for this suite. - test/e2e/framework/framework.go:351 @ 03/19/23 04:44:10.473 STEP: Destroying namespace "webhook-markers-136" for this suite. - test/e2e/framework/framework.go:351 @ 03/19/23 04:44:10.518 < Exit [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - tear down framework | framework.go:206 @ 03/19/23 04:44:10.565 (92ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:44:10.565 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:44:10.565 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\spod\sand\sapply\sdefaults\safter\smutation\s\[Conformance\]$'
[FAILED] Internal error occurred: failed calling webhook "adding-init-container.k8s.io": failed to call webhook: Post "https://e2e-test-webhook.webhook-5315.svc:8443/mutating-pods?timeout=10s": context deadline exceeded In [It] at: test/e2e/apimachinery/webhook.go:1028 @ 03/19/23 04:36:23.105from junit_01.xml
> Enter [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - set up framework | framework.go:191 @ 03/19/23 04:35:54.562 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/19/23 04:35:54.562 Mar 19 04:35:54.562: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook - test/e2e/framework/framework.go:250 @ 03/19/23 04:35:54.563 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/19/23 04:35:54.988 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/19/23 04:35:55.195 < Exit [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - set up framework | framework.go:191 @ 03/19/23 04:35:55.407 (845ms) > Enter [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:35:55.407 < Exit [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:35:55.407 (0s) > Enter [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/apimachinery/webhook.go:91 @ 03/19/23 04:35:55.407 STEP: Setting up server cert - test/e2e/apimachinery/webhook.go:99 @ 03/19/23 04:35:56.021 STEP: Create role binding to let webhook read extension-apiserver-authentication - test/e2e/apimachinery/webhook.go:709 @ 03/19/23 04:35:56.535 STEP: Deploying the webhook pod - test/e2e/apimachinery/webhook.go:741 @ 03/19/23 04:35:56.64 STEP: Wait for the deployment to be ready - test/e2e/apimachinery/webhook.go:811 @ 03/19/23 04:35:56.799 Mar 19 04:35:56.954: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Mar 19 04:35:59.370: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.March, 19, 4, 35, 56, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 19, 4, 35, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.March, 19, 4, 35, 57, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 19, 4, 35, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-7497495989\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service - test/e2e/apimachinery/webhook.go:817 @ 03/19/23 04:36:01.457 STEP: Verifying the service has paired with the endpoint - test/e2e/apimachinery/webhook.go:840 @ 03/19/23 04:36:01.594 Mar 19 04:36:02.595: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 < Exit [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/apimachinery/webhook.go:91 @ 03/19/23 04:36:02.677 (7.27s) > Enter [It] should mutate pod and apply defaults after mutation [Conformance] - test/e2e/apimachinery/webhook.go:260 @ 03/19/23 04:36:02.677 STEP: Registering the mutating pod webhook via the AdmissionRegistration API - test/e2e/apimachinery/webhook.go:975 @ 03/19/23 04:36:02.677 Mar 19 04:36:12.873: INFO: Waiting for webhook configuration to be ready... STEP: create a pod that should be updated by the webhook - test/e2e/apimachinery/webhook.go:1024 @ 03/19/23 04:36:13.06 Mar 19 04:36:23.105: INFO: Unexpected error: <*errors.StatusError | 0xc003f123c0>: Internal error occurred: failed calling webhook "adding-init-container.k8s.io": failed to call webhook: Post "https://e2e-test-webhook.webhook-5315.svc:8443/mutating-pods?timeout=10s": context deadline exceeded { ErrStatus: code: 500 details: causes: - message: 'failed calling webhook "adding-init-container.k8s.io": failed to call webhook: Post "https://e2e-test-webhook.webhook-5315.svc:8443/mutating-pods?timeout=10s": context deadline exceeded' message: 'Internal error occurred: failed calling webhook "adding-init-container.k8s.io": failed to call webhook: Post "https://e2e-test-webhook.webhook-5315.svc:8443/mutating-pods?timeout=10s": context deadline exceeded' metadata: {} reason: InternalError status: Failure, } [FAILED] Internal error occurred: failed calling webhook "adding-init-container.k8s.io": failed to call webhook: Post "https://e2e-test-webhook.webhook-5315.svc:8443/mutating-pods?timeout=10s": context deadline exceeded In [It] at: test/e2e/apimachinery/webhook.go:1028 @ 03/19/23 04:36:23.105 < Exit [It] should mutate pod and apply defaults after mutation [Conformance] - test/e2e/apimachinery/webhook.go:260 @ 03/19/23 04:36:23.105 (20.428s) > Enter [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:36:23.105 Mar 19 04:36:23.105: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:36:23.238 (133ms) > Enter [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/apimachinery/webhook.go:106 @ 03/19/23 04:36:23.238 < Exit [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/apimachinery/webhook.go:106 @ 03/19/23 04:36:23.512 (274ms) > Enter [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/apimachinery/webhook.go:1020 @ 03/19/23 04:36:23.512 < Exit [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/apimachinery/webhook.go:1020 @ 03/19/23 04:36:23.561 (49ms) > Enter [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:36:23.561 < Exit [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:36:23.561 (0s) > Enter [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - dump namespaces | framework.go:209 @ 03/19/23 04:36:23.561 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:36:23.562 STEP: Collecting events from namespace "webhook-5315". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:36:23.562 STEP: Found 8 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:36:23.606 Mar 19 04:36:23.606: INFO: At 2023-03-19 04:35:56 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-7497495989 to 1 Mar 19 04:36:23.606: INFO: At 2023-03-19 04:35:56 +0000 UTC - event for sample-webhook-deployment-7497495989: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-7497495989-zpwzh Mar 19 04:36:23.606: INFO: At 2023-03-19 04:35:56 +0000 UTC - event for sample-webhook-deployment-7497495989-zpwzh: {default-scheduler } Scheduled: Successfully assigned webhook-5315/sample-webhook-deployment-7497495989-zpwzh to e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:36:23.606: INFO: At 2023-03-19 04:35:58 +0000 UTC - event for sample-webhook-deployment-7497495989-zpwzh: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} FailedMount: MountVolume.SetUp failed for volume "webhook-certs" : failed to sync secret cache: timed out waiting for the condition Mar 19 04:36:23.606: INFO: At 2023-03-19 04:35:59 +0000 UTC - event for sample-webhook-deployment-7497495989-zpwzh: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 19 04:36:23.606: INFO: At 2023-03-19 04:35:59 +0000 UTC - event for sample-webhook-deployment-7497495989-zpwzh: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} Created: Created container sample-webhook Mar 19 04:36:23.606: INFO: At 2023-03-19 04:35:59 +0000 UTC - event for sample-webhook-deployment-7497495989-zpwzh: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} Started: Started container sample-webhook Mar 19 04:36:23.606: INFO: At 2023-03-19 04:36:23 +0000 UTC - event for sample-webhook-deployment-7497495989-zpwzh: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} Killing: Stopping container sample-webhook Mar 19 04:36:23.648: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:36:23.648: INFO: Mar 19 04:36:23.700: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:36:23.749: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 15766 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:35:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:36:23.749: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:36:23.813: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:36:23.877: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:23.877: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:36:23.877: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:23.877: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:36:23.877: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:23.877: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:36:23.877: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:23.877: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:36:23.877: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:23.877: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:36:23.877: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:23.877: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:36:23.877: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:23.877: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:36:23.877: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:36:23.877: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:23.877: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:36:23.877: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:23.877: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:36:24.103: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:36:24.103: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:36:24.222: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 19439 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1956":"e2e-c595d7501c-674b9-minion-group-gmd9","csi-mock-csi-mock-volumes-expansion-156":"e2e-c595d7501c-674b9-minion-group-gmd9","csi-mock-csi-mock-volumes-workload-8457":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:33:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-19 04:36:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-19 04:36:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:36:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-8457^62d6dba5-c60f-11ed-8373-8e2c5eb2cb46],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-8457^62d6dba5-c60f-11ed-8373-8e2c5eb2cb46,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1956^96e426bc-c60f-11ed-8a76-ce88f75d547b,DevicePath:,},},Config:nil,},} Mar 19 04:36:24.222: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:36:24.339: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:36:24.542: INFO: pvc-volume-tester-bg7qz started at 2023-03-19 04:36:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container volume-tester ready: true, restart count 0 Mar 19 04:36:24.542: INFO: inline-volume-tester-thz8b started at 2023-03-19 04:36:17 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:36:24.542: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:34:39 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:36:24.542: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:36:24.542: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:24.542: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:36:24.542: INFO: inline-volume-tester-vztfw started at 2023-03-19 04:35:24 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:36:24.542: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:36:13 +0000 UTC (0+7 container statuses recorded) Mar 19 04:36:24.542: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:36:24.542: INFO: pvc-volume-tester-2f5j7 started at 2023-03-19 04:34:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container volume-tester ready: true, restart count 0 Mar 19 04:36:24.542: INFO: pod-ce4946c2-e8f5-4774-9e76-18d55210674d started at 2023-03-19 04:35:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:36:24.542: INFO: external-provisioner-fxpkq started at 2023-03-19 04:35:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:36:24.542: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container httpd ready: true, restart count 0 Mar 19 04:36:24.542: INFO: replace-27986676-mw2jp started at 2023-03-19 04:36:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container c ready: true, restart count 0 Mar 19 04:36:24.542: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:36:24.542: INFO: csi-mockplugin-0 started at 2023-03-19 04:34:39 +0000 UTC (0+3 container statuses recorded) Mar 19 04:36:24.542: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container mock ready: true, restart count 0 Mar 19 04:36:24.542: INFO: affinity-nodeport-timeout-pdlsj started at 2023-03-19 04:35:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Mar 19 04:36:24.542: INFO: inline-volume-4dwm5 started at 2023-03-19 04:35:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container volume-tester ready: false, restart count 0 Mar 19 04:36:24.542: INFO: csi-mockplugin-0 started at 2023-03-19 04:36:02 +0000 UTC (0+3 container statuses recorded) Mar 19 04:36:24.542: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container mock ready: true, restart count 0 Mar 19 04:36:24.542: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-8mhb5 started at 2023-03-19 04:36:20 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:24.542: INFO: external-provisioner-dzhmt started at 2023-03-19 04:35:16 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:36:24.542: INFO: test-webserver-92bef116-fc7a-4dc1-91c0-556f7cb58af5 started at 2023-03-19 04:35:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container test-webserver ready: true, restart count 0 Mar 19 04:36:24.542: INFO: netserver-0 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container webserver ready: true, restart count 0 Mar 19 04:36:24.542: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:36:02 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:36:24.542: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-p5554 started at 2023-03-19 04:35:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:24.542: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:24.542: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:36:24.542: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:24.542: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:36:24.542: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:36:24.915: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:36:24.915: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:36:24.966: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 19647 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-7644":"e2e-c595d7501c-674b9-minion-group-kd0v"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:33:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-19 04:36:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-03-19 04:36:23 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:36:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-7644^98cee9a9-c60f-11ed-8268-5e4e4e04e978,DevicePath:,},},Config:nil,},} Mar 19 04:36:24.966: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:36:25.027: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:36:25.160: INFO: execpod-affinityqsvmd started at 2023-03-19 04:35:56 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:25.160: INFO: pod-projected-configmaps-d47989d6-6a57-4435-abc9-f2ffd0b68aaf started at 2023-03-19 04:36:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container agnhost-container ready: false, restart count 0 Mar 19 04:36:25.160: INFO: kube-proxy-mode-detector started at 2023-03-19 04:35:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:25.160: INFO: metadata-proxy-v0.1-bxcx5 started at 2023-03-19 04:28:34 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:25.160: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:36:25.160: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:36:25.160: INFO: pod-subpath-test-dynamicpv-lbnl started at 2023-03-19 04:36:23 +0000 UTC (2+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Init container init-volume-dynamicpv-lbnl ready: false, restart count 0 Mar 19 04:36:25.160: INFO: Init container test-init-volume-dynamicpv-lbnl ready: false, restart count 0 Mar 19 04:36:25.160: INFO: Container test-container-subpath-dynamicpv-lbnl ready: false, restart count 0 Mar 19 04:36:25.160: INFO: konnectivity-agent-n8mzc started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:36:25.160: INFO: nfs-server started at 2023-03-19 04:36:16 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container nfs-server ready: true, restart count 0 Mar 19 04:36:25.160: INFO: affinity-nodeport-timeout-64zbz started at 2023-03-19 04:35:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Mar 19 04:36:25.160: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:36:18 +0000 UTC (0+7 container statuses recorded) Mar 19 04:36:25.160: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:36:25.160: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:25.160: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:36:25.160: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:36:25.160: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:36:25.160: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:36:25.160: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:36:25.160: INFO: pfpod started at 2023-03-19 04:36:21 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:25.160: INFO: Container portforwardtester ready: true, restart count 0 Mar 19 04:36:25.160: INFO: Container readiness ready: false, restart count 0 Mar 19 04:36:25.160: INFO: concurrent-27986676-r22bq started at 2023-03-19 04:36:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container c ready: false, restart count 0 Mar 19 04:36:25.160: INFO: coredns-8f5847b64-rzgwn started at 2023-03-19 04:28:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container coredns ready: true, restart count 0 Mar 19 04:36:25.160: INFO: webserver-pod started at 2023-03-19 04:33:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container agnhost ready: false, restart count 0 Mar 19 04:36:25.160: INFO: exec-volume-test-inlinevolume-zs82 started at 2023-03-19 04:36:20 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container exec-container-inlinevolume-zs82 ready: true, restart count 0 Mar 19 04:36:25.160: INFO: netserver-1 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container webserver ready: true, restart count 0 Mar 19 04:36:25.160: INFO: test-container-pod started at 2023-03-19 04:36:18 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container webserver ready: true, restart count 0 Mar 19 04:36:25.160: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-ktd46 started at 2023-03-19 04:36:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:25.160: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-kd0v started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:36:25.160: INFO: npd-v0.8.9-xn47l started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:36:25.160: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-p9qjc started at 2023-03-19 04:36:04 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:25.160: INFO: external-provisioner-6slck started at 2023-03-19 04:36:14 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:36:25.160: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-rd9zl started at 2023-03-19 04:36:19 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.160: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:25.476: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:36:25.476: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:36:25.531: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-rx1t 81031ff0-6ac7-4503-8384-dada37cf30f8 19219 0 2023-03-19 04:28:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-rx1t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-rx1t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1001":"e2e-c595d7501c-674b9-minion-group-rx1t","csi-hostpath-volume-expand-3732":"e2e-c595d7501c-674b9-minion-group-rx1t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2023-03-19 04:33:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:35:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:36:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-rx1t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:05 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:05 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:05 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:36:05 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.10.228,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:515db57784a9c6bd89ce17868c72021b,SystemUUID:515db577-84a9-c6bd-89ce-17868c72021b,BootID:744f3d9d-8dea-4311-872e-96785d8e8169,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1001^82335385-c60f-11ed-9dd0-1249ff02aa72 kubernetes.io/csi/csi-hostpath-volume-expand-3732^7a9fd2d1-c60f-11ed-b927-464307a32a72],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1001^82335385-c60f-11ed-9dd0-1249ff02aa72,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-3732^7a9fd2d1-c60f-11ed-b927-464307a32a72,DevicePath:,},},Config:nil,},} Mar 19 04:36:25.531: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:36:25.594: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:36:25.697: INFO: npd-v0.8.9-j2c8h started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:36:25.697: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:35:39 +0000 UTC (0+7 container statuses recorded) Mar 19 04:36:25.697: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:36:25.697: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-rx1t started at 2023-03-19 04:28:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:36:25.697: INFO: inline-volume-tester-gsht5 started at 2023-03-19 04:35:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:36:25.697: INFO: volume-snapshot-controller-0 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container volume-snapshot-controller ready: true, restart count 0 Mar 19 04:36:25.697: INFO: metadata-proxy-v0.1-tlkct started at 2023-03-19 04:28:35 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:25.697: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:36:25.697: INFO: csi-mockplugin-0 started at 2023-03-19 04:35:59 +0000 UTC (0+4 container statuses recorded) Mar 19 04:36:25.697: INFO: Container busybox ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container csi-provisioner ready: true, restart count 1 Mar 19 04:36:25.697: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container mock ready: true, restart count 0 Mar 19 04:36:25.697: INFO: coredns-8f5847b64-cb89d started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container coredns ready: true, restart count 0 Mar 19 04:36:25.697: INFO: l7-default-backend-856d874f49-9wsfv started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container default-http-backend ready: true, restart count 0 Mar 19 04:36:25.697: INFO: konnectivity-agent-m2cxq started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:36:25.697: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-8qmbx started at <nil> (0+0 container statuses recorded) Mar 19 04:36:25.697: INFO: webserver-pod started at 2023-03-19 04:33:30 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container agnhost ready: false, restart count 0 Mar 19 04:36:25.697: INFO: pod-e8006d97-b241-447f-9e48-63bef264b69f started at 2023-03-19 04:35:58 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:36:25.697: INFO: affinity-nodeport-timeout-6wczq started at 2023-03-19 04:35:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Mar 19 04:36:25.697: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-zdf2r started at 2023-03-19 04:35:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:25.697: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:35:27 +0000 UTC (0+7 container statuses recorded) Mar 19 04:36:25.697: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:36:25.697: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:36:25.697: INFO: pod-6f8bdec0-c737-4cd3-b834-440dd4ce480c started at 2023-03-19 04:35:32 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:36:25.697: INFO: kube-dns-autoscaler-7b444c59c9-28g2s started at 2023-03-19 04:31:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container autoscaler ready: true, restart count 0 Mar 19 04:36:25.697: INFO: netserver-2 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:25.697: INFO: Container webserver ready: true, restart count 0 Mar 19 04:36:26.078: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-rx1t STEP: Collecting events from namespace "webhook-markers-685". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:36:26.078 STEP: Found 0 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:36:26.135 Mar 19 04:36:26.183: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:36:26.183: INFO: Mar 19 04:36:26.235: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:36:26.288: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 15766 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:35:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:36:26.288: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:36:26.338: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:36:26.413: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.413: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:36:26.413: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.413: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:36:26.413: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:26.413: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:36:26.413: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:36:26.413: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.413: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:36:26.413: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.413: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:36:26.413: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.413: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:36:26.413: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.413: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:36:26.413: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.413: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:36:26.413: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.413: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:36:26.640: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:36:26.640: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:36:26.683: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 19726 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1956":"e2e-c595d7501c-674b9-minion-group-gmd9","csi-mock-csi-mock-volumes-expansion-156":"e2e-c595d7501c-674b9-minion-group-gmd9","csi-mock-csi-mock-volumes-workload-8457":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:33:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:36:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:36:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:25 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:25 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:25 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:36:25 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1956^96e426bc-c60f-11ed-8a76-ce88f75d547b kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-8457^62d6dba5-c60f-11ed-8373-8e2c5eb2cb46],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-8457^62d6dba5-c60f-11ed-8373-8e2c5eb2cb46,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1956^96e426bc-c60f-11ed-8a76-ce88f75d547b,DevicePath:,},},Config:nil,},} Mar 19 04:36:26.683: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:36:26.728: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:36:26.784: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container httpd ready: true, restart count 0 Mar 19 04:36:26.784: INFO: affinity-nodeport-timeout-pdlsj started at 2023-03-19 04:35:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Mar 19 04:36:26.784: INFO: replace-27986676-mw2jp started at 2023-03-19 04:36:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container c ready: true, restart count 0 Mar 19 04:36:26.784: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:36:26.784: INFO: csi-mockplugin-0 started at 2023-03-19 04:34:39 +0000 UTC (0+3 container statuses recorded) Mar 19 04:36:26.784: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container mock ready: true, restart count 0 Mar 19 04:36:26.784: INFO: inline-volume-4dwm5 started at 2023-03-19 04:35:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container volume-tester ready: false, restart count 0 Mar 19 04:36:26.784: INFO: csi-mockplugin-0 started at 2023-03-19 04:36:02 +0000 UTC (0+3 container statuses recorded) Mar 19 04:36:26.784: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container mock ready: true, restart count 0 Mar 19 04:36:26.784: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:36:02 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:36:26.784: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-8mhb5 started at 2023-03-19 04:36:20 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:26.784: INFO: external-provisioner-dzhmt started at 2023-03-19 04:35:16 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:36:26.784: INFO: test-webserver-92bef116-fc7a-4dc1-91c0-556f7cb58af5 started at 2023-03-19 04:35:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container test-webserver ready: true, restart count 0 Mar 19 04:36:26.784: INFO: netserver-0 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container webserver ready: true, restart count 0 Mar 19 04:36:26.784: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-p5554 started at 2023-03-19 04:35:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:26.784: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:36:26.784: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:26.784: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:36:26.784: INFO: pvc-volume-tester-bg7qz started at 2023-03-19 04:36:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container volume-tester ready: true, restart count 0 Mar 19 04:36:26.784: INFO: inline-volume-tester-thz8b started at 2023-03-19 04:36:17 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:36:26.784: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:34:39 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:36:26.784: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:36:26.784: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:26.784: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:36:26.784: INFO: inline-volume-tester-vztfw started at 2023-03-19 04:35:24 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:36:26.784: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:36:13 +0000 UTC (0+7 container statuses recorded) Mar 19 04:36:26.784: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:36:26.784: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:36:26.784: INFO: pvc-volume-tester-2f5j7 started at 2023-03-19 04:34:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container volume-tester ready: true, restart count 0 Mar 19 04:36:26.784: INFO: pod-ce4946c2-e8f5-4774-9e76-18d55210674d started at 2023-03-19 04:35:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:26.784: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:36:27.088: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:36:27.088: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:36:27.141: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 19647 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-7644":"e2e-c595d7501c-674b9-minion-group-kd0v"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:33:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-19 04:36:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-03-19 04:36:23 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:36:07 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-7644^98cee9a9-c60f-11ed-8268-5e4e4e04e978,DevicePath:,},},Config:nil,},} Mar 19 04:36:27.141: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:36:27.185: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:36:27.257: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:36:18 +0000 UTC (0+7 container statuses recorded) Mar 19 04:36:27.257: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:36:27.257: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:27.257: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:36:27.257: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:36:27.257: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:36:27.257: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:36:27.257: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:36:27.257: INFO: pfpod started at 2023-03-19 04:36:21 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:27.257: INFO: Container portforwardtester ready: true, restart count 0 Mar 19 04:36:27.257: INFO: Container readiness ready: false, restart count 0 Mar 19 04:36:27.257: INFO: netserver-1 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container webserver ready: true, restart count 0 Mar 19 04:36:27.257: INFO: concurrent-27986676-r22bq started at 2023-03-19 04:36:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container c ready: false, restart count 0 Mar 19 04:36:27.257: INFO: coredns-8f5847b64-rzgwn started at 2023-03-19 04:28:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container coredns ready: true, restart count 0 Mar 19 04:36:27.257: INFO: webserver-pod started at 2023-03-19 04:33:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container agnhost ready: false, restart count 0 Mar 19 04:36:27.257: INFO: exec-volume-test-inlinevolume-zs82 started at 2023-03-19 04:36:20 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container exec-container-inlinevolume-zs82 ready: true, restart count 0 Mar 19 04:36:27.257: INFO: test-container-pod started at 2023-03-19 04:36:18 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container webserver ready: true, restart count 0 Mar 19 04:36:27.257: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-ktd46 started at 2023-03-19 04:36:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:27.257: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-kd0v started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:36:27.257: INFO: pod-secrets-4f905746-ba93-4846-bd9c-1d0059f3eda9 started at 2023-03-19 04:36:26 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container secret-test ready: true, restart count 0 Mar 19 04:36:27.257: INFO: var-expansion-11465754-88ad-46f2-9911-79956283600f started at 2023-03-19 04:36:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container dapi-container ready: false, restart count 0 Mar 19 04:36:27.257: INFO: npd-v0.8.9-xn47l started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:36:27.257: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-p9qjc started at 2023-03-19 04:36:04 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:27.257: INFO: external-provisioner-6slck started at 2023-03-19 04:36:14 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:36:27.257: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-rd9zl started at 2023-03-19 04:36:19 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:27.257: INFO: busybox-user-0-11b14f5c-ccb8-4e61-9f90-64ab6581f4a0 started at 2023-03-19 04:36:27 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container busybox-user-0-11b14f5c-ccb8-4e61-9f90-64ab6581f4a0 ready: false, restart count 0 Mar 19 04:36:27.257: INFO: execpod-affinityqsvmd started at 2023-03-19 04:35:56 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:27.257: INFO: pod-projected-configmaps-6f973db9-11ff-4d46-bd5c-5fdeda812e41 started at 2023-03-19 04:36:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container agnhost-container ready: false, restart count 0 Mar 19 04:36:27.257: INFO: pod-projected-configmaps-d47989d6-6a57-4435-abc9-f2ffd0b68aaf started at 2023-03-19 04:36:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container agnhost-container ready: false, restart count 0 Mar 19 04:36:27.257: INFO: kube-proxy-mode-detector started at 2023-03-19 04:35:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:27.257: INFO: metadata-proxy-v0.1-bxcx5 started at 2023-03-19 04:28:34 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:27.257: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:36:27.257: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:36:27.257: INFO: pod-subpath-test-dynamicpv-lbnl started at 2023-03-19 04:36:23 +0000 UTC (2+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Init container init-volume-dynamicpv-lbnl ready: false, restart count 0 Mar 19 04:36:27.257: INFO: Init container test-init-volume-dynamicpv-lbnl ready: false, restart count 0 Mar 19 04:36:27.257: INFO: Container test-container-subpath-dynamicpv-lbnl ready: false, restart count 0 Mar 19 04:36:27.257: INFO: konnectivity-agent-n8mzc started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:36:27.257: INFO: nfs-server started at 2023-03-19 04:36:16 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container nfs-server ready: true, restart count 0 Mar 19 04:36:27.257: INFO: affinity-nodeport-timeout-64zbz started at 2023-03-19 04:35:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:27.257: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Mar 19 04:36:27.724: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:36:27.724: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:36:27.814: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-rx1t 81031ff0-6ac7-4503-8384-dada37cf30f8 19219 0 2023-03-19 04:28:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-rx1t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-rx1t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1001":"e2e-c595d7501c-674b9-minion-group-rx1t","csi-hostpath-volume-expand-3732":"e2e-c595d7501c-674b9-minion-group-rx1t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2023-03-19 04:33:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:35:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:36:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-rx1t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:05 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:05 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:05 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:36:05 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.10.228,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:515db57784a9c6bd89ce17868c72021b,SystemUUID:515db577-84a9-c6bd-89ce-17868c72021b,BootID:744f3d9d-8dea-4311-872e-96785d8e8169,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1001^82335385-c60f-11ed-9dd0-1249ff02aa72 kubernetes.io/csi/csi-hostpath-volume-expand-3732^7a9fd2d1-c60f-11ed-b927-464307a32a72],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1001^82335385-c60f-11ed-9dd0-1249ff02aa72,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-3732^7a9fd2d1-c60f-11ed-b927-464307a32a72,DevicePath:,},},Config:nil,},} Mar 19 04:36:27.814: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:36:27.920: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:36:28.022: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-8qmbx started at 2023-03-19 04:36:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:28.022: INFO: webserver-pod started at 2023-03-19 04:33:30 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container agnhost ready: false, restart count 0 Mar 19 04:36:28.022: INFO: pod-e8006d97-b241-447f-9e48-63bef264b69f started at 2023-03-19 04:35:58 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:36:28.022: INFO: affinity-nodeport-timeout-6wczq started at 2023-03-19 04:35:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Mar 19 04:36:28.022: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-zdf2r started at 2023-03-19 04:35:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:36:28.022: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:35:27 +0000 UTC (0+7 container statuses recorded) Mar 19 04:36:28.022: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:36:28.022: INFO: pod-6f8bdec0-c737-4cd3-b834-440dd4ce480c started at 2023-03-19 04:35:32 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:36:28.022: INFO: kube-dns-autoscaler-7b444c59c9-28g2s started at 2023-03-19 04:31:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container autoscaler ready: true, restart count 0 Mar 19 04:36:28.022: INFO: netserver-2 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container webserver ready: true, restart count 0 Mar 19 04:36:28.022: INFO: npd-v0.8.9-j2c8h started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:36:28.022: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:35:39 +0000 UTC (0+7 container statuses recorded) Mar 19 04:36:28.022: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:36:28.022: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-rx1t started at 2023-03-19 04:28:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:36:28.022: INFO: inline-volume-tester-gsht5 started at 2023-03-19 04:35:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:36:28.022: INFO: volume-snapshot-controller-0 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container volume-snapshot-controller ready: true, restart count 0 Mar 19 04:36:28.022: INFO: metadata-proxy-v0.1-tlkct started at 2023-03-19 04:28:35 +0000 UTC (0+2 container statuses recorded) Mar 19 04:36:28.022: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:36:28.022: INFO: csi-mockplugin-0 started at 2023-03-19 04:35:59 +0000 UTC (0+4 container statuses recorded) Mar 19 04:36:28.022: INFO: Container busybox ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container csi-provisioner ready: true, restart count 1 Mar 19 04:36:28.022: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:36:28.022: INFO: Container mock ready: true, restart count 0 Mar 19 04:36:28.022: INFO: coredns-8f5847b64-cb89d started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container coredns ready: true, restart count 0 Mar 19 04:36:28.022: INFO: l7-default-backend-856d874f49-9wsfv started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container default-http-backend ready: true, restart count 0 Mar 19 04:36:28.022: INFO: konnectivity-agent-m2cxq started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:36:28.022: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:36:28.560: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-rx1t END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:36:28.56 (4.999s) < Exit [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - dump namespaces | framework.go:209 @ 03/19/23 04:36:28.56 (4.999s) > Enter [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - tear down framework | framework.go:206 @ 03/19/23 04:36:28.56 STEP: Destroying namespace "webhook-5315" for this suite. - test/e2e/framework/framework.go:351 @ 03/19/23 04:36:28.56 STEP: Destroying namespace "webhook-markers-685" for this suite. - test/e2e/framework/framework.go:351 @ 03/19/23 04:36:28.772 < Exit [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] - tear down framework | framework.go:206 @ 03/19/23 04:36:28.952 (392ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:36:28.952 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:36:28.952 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-auth\]\sServiceAccounts\sshould\smount\san\sAPI\stoken\sinto\spods\s\s\[Conformance\]$'
[FAILED] exit status 1 In [It] at: test/e2e/auth/service_accounts.go:103 @ 03/19/23 04:38:40.91from junit_01.xml
> Enter [BeforeEach] [sig-auth] ServiceAccounts - set up framework | framework.go:191 @ 03/19/23 04:38:08.099 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/19/23 04:38:08.099 Mar 19 04:38:08.099: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename svcaccounts - test/e2e/framework/framework.go:250 @ 03/19/23 04:38:08.1 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/19/23 04:38:08.227 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/19/23 04:38:08.308 < Exit [BeforeEach] [sig-auth] ServiceAccounts - set up framework | framework.go:191 @ 03/19/23 04:38:08.39 (291ms) > Enter [BeforeEach] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:38:08.39 < Exit [BeforeEach] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:38:08.39 (0s) > Enter [It] should mount an API token into pods [Conformance] - test/e2e/auth/service_accounts.go:78 @ 03/19/23 04:38:08.39 STEP: reading a file in the container - test/e2e/framework/kubectl/kubectl_utils.go:154 @ 03/19/23 04:38:10.569 Mar 19 04:38:10.569: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl exec --namespace=svcaccounts-3344 pod-service-account-8f3c3cf2-073f-4dce-9e2e-6f7a3980ff80 -c=test -- cat /var/run/secrets/kubernetes.io/serviceaccount/token' Mar 19 04:38:40.910: INFO: error running kubectl exec to read file: exit status 1 stdout= stderr=Error from server: error dialing backend: dial timeout, backstop ) Mar 19 04:38:40.910: INFO: Unexpected error: <*exec.ExitError | 0xc0000db140>: exit status 1 { ProcessState: { pid: 87342, status: 256, rusage: { Utime: {Sec: 0, Usec: 60201}, Stime: {Sec: 0, Usec: 40134}, Maxrss: 187068, Ixrss: 0, Idrss: 0, Isrss: 0, Minflt: 4603, Majflt: 0, Nswap: 0, Inblock: 0, Oublock: 0, Msgsnd: 0, Msgrcv: 0, Nsignals: 0, Nvcsw: 553, Nivcsw: 4, }, }, Stderr: nil, } [FAILED] exit status 1 In [It] at: test/e2e/auth/service_accounts.go:103 @ 03/19/23 04:38:40.91 < Exit [It] should mount an API token into pods [Conformance] - test/e2e/auth/service_accounts.go:78 @ 03/19/23 04:38:40.91 (32.521s) > Enter [AfterEach] [sig-auth] ServiceAccounts - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:38:40.911 Mar 19 04:38:40.911: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-auth] ServiceAccounts - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:38:40.999 (88ms) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:38:40.999 < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:38:40.999 (0s) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - dump namespaces | framework.go:209 @ 03/19/23 04:38:40.999 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:38:40.999 STEP: Collecting events from namespace "svcaccounts-3344". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:38:40.999 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:38:41.042 Mar 19 04:38:41.042: INFO: At 2023-03-19 04:38:08 +0000 UTC - event for pod-service-account-8f3c3cf2-073f-4dce-9e2e-6f7a3980ff80: {default-scheduler } Scheduled: Successfully assigned svcaccounts-3344/pod-service-account-8f3c3cf2-073f-4dce-9e2e-6f7a3980ff80 to e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:38:41.042: INFO: At 2023-03-19 04:38:09 +0000 UTC - event for pod-service-account-8f3c3cf2-073f-4dce-9e2e-6f7a3980ff80: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 19 04:38:41.042: INFO: At 2023-03-19 04:38:09 +0000 UTC - event for pod-service-account-8f3c3cf2-073f-4dce-9e2e-6f7a3980ff80: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} Created: Created container test Mar 19 04:38:41.042: INFO: At 2023-03-19 04:38:09 +0000 UTC - event for pod-service-account-8f3c3cf2-073f-4dce-9e2e-6f7a3980ff80: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} Started: Started container test Mar 19 04:38:41.109: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:38:41.109: INFO: pod-service-account-8f3c3cf2-073f-4dce-9e2e-6f7a3980ff80 e2e-c595d7501c-674b9-minion-group-gmd9 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:38:08 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:38:09 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:38:09 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:38:08 +0000 UTC }] Mar 19 04:38:41.109: INFO: Mar 19 04:38:41.317: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:38:41.370: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 15766 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:35:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:38:41.371: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:38:41.424: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:38:41.497: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:41.497: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:38:41.497: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:41.497: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:38:41.497: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:41.497: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:38:41.497: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:41.497: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:38:41.497: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:41.497: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:38:41.497: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:41.497: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:38:41.497: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:41.497: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:38:41.497: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:41.497: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:38:41.497: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:41.497: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:38:41.497: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:38:41.731: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:38:41.731: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:38:41.806: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 24117 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-2276":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:33:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:38:24 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:38:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:28 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:28 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:28 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:38:28 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2276^e0c98dd6-c60f-11ed-941d-b610f14ee05e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2276^e0c98dd6-c60f-11ed-941d-b610f14ee05e,DevicePath:,},},Config:nil,},} Mar 19 04:38:41.807: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:38:41.854: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:38:42.000: INFO: pod3 started at 2023-03-19 04:37:08 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:38:42.000: INFO: test-runtimeclass-runtimeclass-5536-preconfigured-handler-4fn8b started at 2023-03-19 04:38:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container test ready: false, restart count 0 Mar 19 04:38:42.000: INFO: ss2-1 started at 2023-03-19 04:37:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container webserver ready: false, restart count 0 Mar 19 04:38:42.000: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container httpd ready: true, restart count 0 Mar 19 04:38:42.000: INFO: pod-server-1 started at 2023-03-19 04:38:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:38:42.000: INFO: up-down-2-hl7bg started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:38:42.000: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:38:42.000: INFO: pfpod started at 2023-03-19 04:38:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:42.000: INFO: Container portforwardtester ready: false, restart count 0 Mar 19 04:38:42.000: INFO: Container readiness ready: true, restart count 0 Mar 19 04:38:42.000: INFO: busybox-ada8d2fd-4a4b-46dd-b1ef-2d9e4a6cd087 started at 2023-03-19 04:38:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container busybox ready: true, restart count 0 Mar 19 04:38:42.000: INFO: test-webserver-92bef116-fc7a-4dc1-91c0-556f7cb58af5 started at 2023-03-19 04:35:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container test-webserver ready: true, restart count 0 Mar 19 04:38:42.000: INFO: netserver-0 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:42.000: INFO: netserver-0 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container webserver ready: false, restart count 0 Mar 19 04:38:42.000: INFO: inline-volume-tester-wnm8z started at 2023-03-19 04:38:07 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:38:42.000: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:38:16 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:38:42.000: INFO: pod1 started at 2023-03-19 04:37:04 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:38:42.000: INFO: external-provisioner-g5qjr started at 2023-03-19 04:38:27 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:38:42.000: INFO: security-context-a2576b75-5664-49c0-9b23-f7ac0ffd9532 started at 2023-03-19 04:38:39 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container test-container ready: false, restart count 0 Mar 19 04:38:42.000: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:38:42.000: INFO: pod-service-account-8f3c3cf2-073f-4dce-9e2e-6f7a3980ff80 started at 2023-03-19 04:38:08 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container test ready: true, restart count 0 Mar 19 04:38:42.000: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:42.000: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:38:42.000: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:38:42.000: INFO: external-provisioner-pv685 started at 2023-03-19 04:37:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:38:42.000: INFO: pvc-volume-tester-4c68t started at 2023-03-19 04:38:23 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container volume-tester ready: true, restart count 0 Mar 19 04:38:42.000: INFO: pod-projected-secrets-a3c05a44-ca86-4bff-9c11-fbd11f334c29 started at 2023-03-19 04:38:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container projected-secret-volume-test ready: false, restart count 0 Mar 19 04:38:42.000: INFO: pod2 started at 2023-03-19 04:37:06 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:38:42.000: INFO: e2e-host-exec started at 2023-03-19 04:37:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container e2e-host-exec ready: true, restart count 0 Mar 19 04:38:42.000: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:38:42.000: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:42.000: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:38:42.000: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:38:42.000: INFO: csi-mockplugin-0 started at 2023-03-19 04:38:16 +0000 UTC (0+3 container statuses recorded) Mar 19 04:38:42.000: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:38:42.000: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:38:42.000: INFO: Container mock ready: true, restart count 0 Mar 19 04:38:42.000: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:38:16 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:38:42.000: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-b7677 started at 2023-03-19 04:38:40 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.000: INFO: Container agnhost-container ready: false, restart count 0 Mar 19 04:38:42.460: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:38:42.460: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:38:42.541: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 24432 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7282":"e2e-c595d7501c-674b9-minion-group-kd0v","csi-mock-csi-mock-volumes-attach-4120":"e2e-c595d7501c-674b9-minion-group-kd0v"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:33:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:38:32 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:38:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:39 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:39 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:39 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:38:39 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-attach-4120^e558527b-c60f-11ed-86d5-eaff1ec90db5],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-attach-4120^e558527b-c60f-11ed-86d5-eaff1ec90db5,DevicePath:,},},Config:nil,},} Mar 19 04:38:42.541: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:38:42.623: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:38:42.778: INFO: inline-volume-tester2-bdwxn started at 2023-03-19 04:37:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:38:42.778: INFO: pod-server-1 started at 2023-03-19 04:38:28 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:38:42.778: INFO: netserver-1 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container webserver ready: false, restart count 0 Mar 19 04:38:42.778: INFO: metadata-proxy-v0.1-bxcx5 started at 2023-03-19 04:28:34 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:42.778: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:38:42.778: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:38:42.778: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:38:24 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:38:42.778: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-9pkn7 started at 2023-03-19 04:38:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:38:42.778: INFO: konnectivity-agent-n8mzc started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:38:42.778: INFO: verify-service-up-exec-pod-znpd4 started at 2023-03-19 04:37:40 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:38:42.778: INFO: test-grpc-0b6aa968-1734-475e-8787-92e57c84a6b9 started at 2023-03-19 04:37:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:38:42.778: INFO: up-down-2-xg9nt started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:38:42.778: INFO: netserver-1 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:42.778: INFO: coredns-8f5847b64-rzgwn started at 2023-03-19 04:28:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container coredns ready: true, restart count 0 Mar 19 04:38:42.778: INFO: test-container-pod started at 2023-03-19 04:36:18 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:42.778: INFO: csi-mockplugin-0 started at 2023-03-19 04:38:23 +0000 UTC (0+3 container statuses recorded) Mar 19 04:38:42.778: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:38:42.778: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:38:42.778: INFO: Container mock ready: true, restart count 0 Mar 19 04:38:42.778: INFO: deployment-5fc65f5d67-rlhd4 started at 2023-03-19 04:38:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container nginx ready: false, restart count 0 Mar 19 04:38:42.778: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:37:23 +0000 UTC (0+7 container statuses recorded) Mar 19 04:38:42.778: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:38:42.778: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:38:42.778: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:38:42.778: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:38:42.778: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:38:42.778: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:38:42.778: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:38:42.778: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-kd0v started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:38:42.778: INFO: ss2-0 started at 2023-03-19 04:37:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:42.778: INFO: test-grpc-828f8ba9-bb1f-4f6b-aa50-4b0805b20bb6 started at 2023-03-19 04:37:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:38:42.778: INFO: verify-service-up-host-exec-pod started at 2023-03-19 04:37:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:38:42.778: INFO: npd-v0.8.9-xn47l started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:38:42.778: INFO: pvc-volume-tester-8mfzz started at 2023-03-19 04:38:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:42.778: INFO: Container volume-tester ready: false, restart count 0 Mar 19 04:38:43.111: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:38:43.111: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:38:43.179: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-rx1t 81031ff0-6ac7-4503-8384-dada37cf30f8 24068 0 2023-03-19 04:28:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-rx1t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-rx1t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2762":"e2e-c595d7501c-674b9-minion-group-rx1t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2023-03-19 04:33:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:38:19 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:38:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-rx1t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:19 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:19 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:19 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:38:19 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.10.228,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:515db57784a9c6bd89ce17868c72021b,SystemUUID:515db577-84a9-c6bd-89ce-17868c72021b,BootID:744f3d9d-8dea-4311-872e-96785d8e8169,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2762^a2fb09c0-c60f-11ed-9a1c-def901249bfc],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2762^a2fb09c0-c60f-11ed-9a1c-def901249bfc,DevicePath:,},},Config:nil,},} Mar 19 04:38:43.179: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:38:43.345: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:38:43.529: INFO: coredns-8f5847b64-cb89d started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container coredns ready: true, restart count 0 Mar 19 04:38:43.529: INFO: l7-default-backend-856d874f49-9wsfv started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container default-http-backend ready: true, restart count 0 Mar 19 04:38:43.529: INFO: konnectivity-agent-m2cxq started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:38:43.529: INFO: httpd started at 2023-03-19 04:38:28 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container httpd ready: true, restart count 0 Mar 19 04:38:43.529: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:36:35 +0000 UTC (0+7 container statuses recorded) Mar 19 04:38:43.529: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:38:43.529: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:38:43.529: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:38:43.529: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:38:43.529: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:38:43.529: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:38:43.529: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:38:43.529: INFO: up-down-2-kxbkc started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:38:43.529: INFO: evicted-pod started at 2023-03-19 04:38:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container evicted-pod ready: true, restart count 0 Mar 19 04:38:43.529: INFO: webserver-67bd4bf6dc-mzkvn started at <nil> (0+0 container statuses recorded) Mar 19 04:38:43.529: INFO: netserver-2 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container webserver ready: false, restart count 0 Mar 19 04:38:43.529: INFO: ss2-2 started at 2023-03-19 04:37:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:43.529: INFO: webserver-67bd4bf6dc-nw62s started at <nil> (0+0 container statuses recorded) Mar 19 04:38:43.529: INFO: pod-client started at 2023-03-19 04:38:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container pod-client ready: true, restart count 0 Mar 19 04:38:43.529: INFO: inline-volume-tester-47g8d started at 2023-03-19 04:38:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:38:43.529: INFO: deployment-5fc65f5d67-dqkdz started at 2023-03-19 04:38:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container nginx ready: false, restart count 0 Mar 19 04:38:43.529: INFO: kube-dns-autoscaler-7b444c59c9-28g2s started at 2023-03-19 04:31:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container autoscaler ready: true, restart count 0 Mar 19 04:38:43.529: INFO: netserver-2 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:43.529: INFO: npd-v0.8.9-j2c8h started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:38:43.529: INFO: pod-secrets-8dc0202d-cdba-45be-874f-67cde42c5d8f started at 2023-03-19 04:38:37 +0000 UTC (0+3 container statuses recorded) Mar 19 04:38:43.529: INFO: Container creates-volume-test ready: true, restart count 0 Mar 19 04:38:43.529: INFO: Container dels-volume-test ready: true, restart count 0 Mar 19 04:38:43.529: INFO: Container upds-volume-test ready: true, restart count 0 Mar 19 04:38:43.529: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-rx1t started at 2023-03-19 04:28:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:38:43.529: INFO: inline-volume-tester-zr8ql started at 2023-03-19 04:36:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:38:43.529: INFO: volume-snapshot-controller-0 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container volume-snapshot-controller ready: true, restart count 0 Mar 19 04:38:43.529: INFO: oidc-discovery-validator started at 2023-03-19 04:38:13 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:43.529: INFO: Container oidc-discovery-validator ready: false, restart count 0 Mar 19 04:38:43.529: INFO: metadata-proxy-v0.1-tlkct started at 2023-03-19 04:28:35 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:43.529: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:38:43.529: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:38:43.529: INFO: csi-mockplugin-0 started at 2023-03-19 04:35:59 +0000 UTC (0+4 container statuses recorded) Mar 19 04:38:43.529: INFO: Container busybox ready: true, restart count 0 Mar 19 04:38:43.529: INFO: Container csi-provisioner ready: false, restart count 3 Mar 19 04:38:43.529: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:38:43.529: INFO: Container mock ready: true, restart count 0 Mar 19 04:38:44.024: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-rx1t END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:38:44.024 (3.025s) < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - dump namespaces | framework.go:209 @ 03/19/23 04:38:44.024 (3.026s) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - tear down framework | framework.go:206 @ 03/19/23 04:38:44.024 STEP: Destroying namespace "svcaccounts-3344" for this suite. - test/e2e/framework/framework.go:351 @ 03/19/23 04:38:44.024 < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - tear down framework | framework.go:206 @ 03/19/23 04:38:44.09 (65ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:38:44.09 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:38:44.09 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sPort\sforwarding\sWith\sa\sserver\slistening\son\s0\.0\.0\.0\sthat\sexpects\sa\sclient\srequest\sshould\ssupport\sa\sclient\sthat\sconnects\,\ssends\sDATA\,\sand\sdisconnects$'
[FAILED] Failed to read from kubectl port-forward stdout: EOF In [It] at: test/e2e/kubectl/portforward.go:191 @ 03/19/23 04:37:00.11from junit_01.xml
> Enter [BeforeEach] [sig-cli] Kubectl Port forwarding - set up framework | framework.go:191 @ 03/19/23 04:36:20.824 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/19/23 04:36:20.824 Mar 19 04:36:20.824: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename port-forwarding - test/e2e/framework/framework.go:250 @ 03/19/23 04:36:20.825 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/19/23 04:36:21.037 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/19/23 04:36:21.15 < Exit [BeforeEach] [sig-cli] Kubectl Port forwarding - set up framework | framework.go:191 @ 03/19/23 04:36:21.248 (424ms) > Enter [BeforeEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:36:21.248 < Exit [BeforeEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:36:21.248 (0s) > Enter [It] should support a client that connects, sends DATA, and disconnects - test/e2e/kubectl/portforward.go:459 @ 03/19/23 04:36:21.248 STEP: Creating the target pod - test/e2e/kubectl/portforward.go:296 @ 03/19/23 04:36:21.248 STEP: Running 'kubectl port-forward' - test/e2e/kubectl/portforward.go:305 @ 03/19/23 04:36:29.681 Mar 19 04:36:29.681: INFO: starting port-forward command and streaming output Mar 19 04:36:29.681: INFO: Asynchronously running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=port-forwarding-2982 port-forward --namespace=port-forwarding-2982 pfpod :80' Mar 19 04:36:29.681: INFO: reading from `kubectl port-forward` command's stdout [FAILED] Failed to read from kubectl port-forward stdout: EOF In [It] at: test/e2e/kubectl/portforward.go:191 @ 03/19/23 04:37:00.11 < Exit [It] should support a client that connects, sends DATA, and disconnects - test/e2e/kubectl/portforward.go:459 @ 03/19/23 04:37:00.11 (38.862s) > Enter [AfterEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:37:00.11 Mar 19 04:37:00.110: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:37:00.211 (100ms) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:37:00.211 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:37:00.211 (0s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - dump namespaces | framework.go:209 @ 03/19/23 04:37:00.211 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:37:00.211 STEP: Collecting events from namespace "port-forwarding-2982". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:37:00.211 STEP: Found 7 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:37:00.273 Mar 19 04:37:00.273: INFO: At 2023-03-19 04:36:21 +0000 UTC - event for pfpod: {default-scheduler } Scheduled: Successfully assigned port-forwarding-2982/pfpod to e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:37:00.273: INFO: At 2023-03-19 04:36:22 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 19 04:37:00.273: INFO: At 2023-03-19 04:36:22 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Created: Created container readiness Mar 19 04:37:00.273: INFO: At 2023-03-19 04:36:22 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Started: Started container readiness Mar 19 04:37:00.273: INFO: At 2023-03-19 04:36:22 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 19 04:37:00.273: INFO: At 2023-03-19 04:36:22 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Created: Created container portforwardtester Mar 19 04:37:00.273: INFO: At 2023-03-19 04:36:22 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Started: Started container portforwardtester Mar 19 04:37:00.315: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:37:00.315: INFO: pfpod e2e-c595d7501c-674b9-minion-group-kd0v Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:36:21 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:36:27 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:36:27 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:36:21 +0000 UTC }] Mar 19 04:37:00.315: INFO: Mar 19 04:37:00.456: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:37:00.504: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 15766 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:35:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:37:00.504: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:37:00.554: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:37:00.665: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:00.665: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:37:00.665: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:00.665: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:37:00.665: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:00.665: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:37:00.665: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:37:00.665: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:37:00.665: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:37:00.665: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:00.665: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:37:00.665: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:00.665: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:37:00.665: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:00.665: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:37:00.665: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:00.665: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:37:00.665: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:00.665: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:37:00.958: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:37:00.958: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:37:01.032: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 20905 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1956":"e2e-c595d7501c-674b9-minion-group-gmd9","csi-mock-csi-mock-volumes-capacity-8953":"e2e-c595d7501c-674b9-minion-group-gmd9","csi-mock-csi-mock-volumes-expansion-156":"e2e-c595d7501c-674b9-minion-group-gmd9","csi-mock-csi-mock-volumes-workload-8457":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:33:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:36:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:36:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:35 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:35 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:35 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:36:35 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1956^96e426bc-c60f-11ed-8a76-ce88f75d547b kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-8457^62d6dba5-c60f-11ed-8373-8e2c5eb2cb46],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-8457^62d6dba5-c60f-11ed-8373-8e2c5eb2cb46,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1956^96e426bc-c60f-11ed-8a76-ce88f75d547b,DevicePath:,},},Config:nil,},} Mar 19 04:37:01.033: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:37:01.089: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:37:01.191: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:34:39 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:37:01.191: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:37:01.191: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:37:01.191: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:37:01.191: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:36:13 +0000 UTC (0+7 container statuses recorded) Mar 19 04:37:01.191: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:37:01.191: INFO: test-ss-1 started at 2023-03-19 04:36:58 +0000 UTC (0+2 container statuses recorded) Mar 19 04:37:01.191: INFO: Container test-ss ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container webserver ready: true, restart count 0 Mar 19 04:37:01.191: INFO: pvc-volume-tester-2f5j7 started at 2023-03-19 04:34:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container volume-tester ready: true, restart count 0 Mar 19 04:37:01.191: INFO: pod-ce4946c2-e8f5-4774-9e76-18d55210674d started at 2023-03-19 04:35:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:37:01.191: INFO: csi-mockplugin-0 started at 2023-03-19 04:36:56 +0000 UTC (0+3 container statuses recorded) Mar 19 04:37:01.191: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container mock ready: true, restart count 0 Mar 19 04:37:01.191: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-q52zr started at 2023-03-19 04:36:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:37:01.191: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container httpd ready: true, restart count 0 Mar 19 04:37:01.191: INFO: replace-27986676-mw2jp started at 2023-03-19 04:36:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container c ready: true, restart count 0 Mar 19 04:37:01.191: INFO: up-down-2-hl7bg started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:37:01.191: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:37:01.191: INFO: csi-mockplugin-0 started at 2023-03-19 04:34:39 +0000 UTC (0+3 container statuses recorded) Mar 19 04:37:01.191: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container mock ready: true, restart count 0 Mar 19 04:37:01.191: INFO: up-down-1-klvlj started at 2023-03-19 04:36:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container up-down-1 ready: true, restart count 0 Mar 19 04:37:01.191: INFO: affinity-nodeport-timeout-pdlsj started at 2023-03-19 04:35:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Mar 19 04:37:01.191: INFO: inline-volume-4dwm5 started at 2023-03-19 04:35:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container volume-tester ready: false, restart count 0 Mar 19 04:37:01.191: INFO: csi-mockplugin-0 started at 2023-03-19 04:36:02 +0000 UTC (0+3 container statuses recorded) Mar 19 04:37:01.191: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container mock ready: true, restart count 0 Mar 19 04:37:01.191: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-8mhb5 started at 2023-03-19 04:36:20 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:37:01.191: INFO: test-webserver-92bef116-fc7a-4dc1-91c0-556f7cb58af5 started at 2023-03-19 04:35:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container test-webserver ready: true, restart count 0 Mar 19 04:37:01.191: INFO: netserver-0 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container webserver ready: true, restart count 0 Mar 19 04:37:01.191: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:36:02 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:37:01.191: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-p5554 started at 2023-03-19 04:35:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:37:01.191: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:37:01.191: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:37:01.191: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:37:01.191: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:37:01.191: INFO: pvc-volume-tester-bg7qz started at 2023-03-19 04:36:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container volume-tester ready: true, restart count 0 Mar 19 04:37:01.191: INFO: inline-volume-tester-thz8b started at 2023-03-19 04:36:17 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:37:01.191: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:36:56 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.191: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:37:01.572: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:37:01.572: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:37:01.614: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 20687 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:33:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:36:23 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-19 04:36:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:37 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:37 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:37 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:36:37 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:37:01.614: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:37:01.659: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:37:01.721: INFO: execpod-affinityqsvmd started at 2023-03-19 04:35:56 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:37:01.721: INFO: replace-27986677-s6wx7 started at 2023-03-19 04:37:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container c ready: false, restart count 0 Mar 19 04:37:01.721: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-887l8 started at 2023-03-19 04:36:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:37:01.721: INFO: kube-proxy-mode-detector started at 2023-03-19 04:35:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:37:01.721: INFO: metadata-proxy-v0.1-bxcx5 started at 2023-03-19 04:28:34 +0000 UTC (0+2 container statuses recorded) Mar 19 04:37:01.721: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:37:01.721: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:37:01.721: INFO: verify-service-up-host-exec-pod started at 2023-03-19 04:36:55 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:37:01.721: INFO: affinity-nodeport-timeout-64zbz started at 2023-03-19 04:35:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Mar 19 04:37:01.721: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-kf8w4 started at 2023-03-19 04:36:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:37:01.721: INFO: konnectivity-agent-n8mzc started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:37:01.721: INFO: pfpod started at 2023-03-19 04:36:21 +0000 UTC (0+2 container statuses recorded) Mar 19 04:37:01.721: INFO: Container portforwardtester ready: true, restart count 0 Mar 19 04:37:01.721: INFO: Container readiness ready: true, restart count 0 Mar 19 04:37:01.721: INFO: up-down-2-xg9nt started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:37:01.721: INFO: concurrent-27986677-lwk6g started at 2023-03-19 04:37:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container c ready: false, restart count 0 Mar 19 04:37:01.721: INFO: netserver-1 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container webserver ready: true, restart count 0 Mar 19 04:37:01.721: INFO: concurrent-27986676-r22bq started at 2023-03-19 04:36:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container c ready: false, restart count 0 Mar 19 04:37:01.721: INFO: coredns-8f5847b64-rzgwn started at 2023-03-19 04:28:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container coredns ready: true, restart count 0 Mar 19 04:37:01.721: INFO: webserver-pod started at 2023-03-19 04:33:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container agnhost ready: false, restart count 0 Mar 19 04:37:01.721: INFO: test-container-pod started at 2023-03-19 04:36:18 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container webserver ready: true, restart count 0 Mar 19 04:37:01.721: INFO: test-ss-0 started at 2023-03-19 04:37:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:37:01.721: INFO: Container test-ss ready: false, restart count 0 Mar 19 04:37:01.721: INFO: Container webserver ready: false, restart count 0 Mar 19 04:37:01.721: INFO: up-down-1-m7nwk started at 2023-03-19 04:36:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container up-down-1 ready: true, restart count 0 Mar 19 04:37:01.721: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-kd0v started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:37:01.721: INFO: foo-f9x25 started at 2023-03-19 04:36:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container c ready: true, restart count 0 Mar 19 04:37:01.721: INFO: local-injector started at 2023-03-19 04:36:27 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container local-injector ready: true, restart count 0 Mar 19 04:37:01.721: INFO: npd-v0.8.9-xn47l started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:37:01.721: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-rd9zl started at 2023-03-19 04:36:19 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:37:01.721: INFO: dns-test-b8bd4692-6a6f-44b1-8d69-571ed5a4385d started at 2023-03-19 04:36:59 +0000 UTC (0+3 container statuses recorded) Mar 19 04:37:01.721: INFO: Container jessie-querier ready: true, restart count 0 Mar 19 04:37:01.721: INFO: Container querier ready: true, restart count 0 Mar 19 04:37:01.721: INFO: Container webserver ready: true, restart count 0 Mar 19 04:37:01.721: INFO: verify-service-up-exec-pod-tr9x6 started at 2023-03-19 04:36:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:37:01.721: INFO: foo-wwst7 started at 2023-03-19 04:36:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:01.721: INFO: Container c ready: true, restart count 0 Mar 19 04:37:02.207: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:37:02.207: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:37:02.250: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-rx1t 81031ff0-6ac7-4503-8384-dada37cf30f8 20848 0 2023-03-19 04:28:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-rx1t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-rx1t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1001":"e2e-c595d7501c-674b9-minion-group-rx1t","csi-hostpath-ephemeral-2762":"e2e-c595d7501c-674b9-minion-group-rx1t","csi-hostpath-provisioning-3108":"e2e-c595d7501c-674b9-minion-group-rx1t","csi-hostpath-provisioning-7838":"e2e-c595d7501c-674b9-minion-group-rx1t","csi-hostpath-volume-expand-3732":"e2e-c595d7501c-674b9-minion-group-rx1t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2023-03-19 04:33:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:36:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:36:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-rx1t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:57 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:57 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:36:57 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:36:57 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.10.228,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:515db57784a9c6bd89ce17868c72021b,SystemUUID:515db577-84a9-c6bd-89ce-17868c72021b,BootID:744f3d9d-8dea-4311-872e-96785d8e8169,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1001^82335385-c60f-11ed-9dd0-1249ff02aa72 kubernetes.io/csi/csi-hostpath-ephemeral-2762^a2fb09c0-c60f-11ed-9a1c-def901249bfc kubernetes.io/csi/csi-hostpath-provisioning-7838^ac3c5880-c60f-11ed-ab35-eec766fbdbe6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-7838^ac3c5880-c60f-11ed-ab35-eec766fbdbe6,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1001^82335385-c60f-11ed-9dd0-1249ff02aa72,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2762^a2fb09c0-c60f-11ed-9a1c-def901249bfc,DevicePath:,},},Config:nil,},} Mar 19 04:37:02.251: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:37:02.295: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:37:02.394: INFO: npd-v0.8.9-j2c8h started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:37:02.394: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:35:39 +0000 UTC (0+7 container statuses recorded) Mar 19 04:37:02.394: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:37:02.394: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-rx1t started at 2023-03-19 04:28:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:37:02.394: INFO: inline-volume-tester-gsht5 started at 2023-03-19 04:35:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:37:02.394: INFO: inline-volume-tester-zr8ql started at 2023-03-19 04:36:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:37:02.394: INFO: volume-snapshot-controller-0 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container volume-snapshot-controller ready: true, restart count 0 Mar 19 04:37:02.394: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:36:35 +0000 UTC (0+7 container statuses recorded) Mar 19 04:37:02.394: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:37:02.394: INFO: up-down-1-2r2lq started at 2023-03-19 04:36:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container up-down-1 ready: true, restart count 0 Mar 19 04:37:02.394: INFO: metadata-proxy-v0.1-tlkct started at 2023-03-19 04:28:35 +0000 UTC (0+2 container statuses recorded) Mar 19 04:37:02.394: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:37:02.394: INFO: csi-mockplugin-0 started at 2023-03-19 04:35:59 +0000 UTC (0+4 container statuses recorded) Mar 19 04:37:02.394: INFO: Container busybox ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-provisioner ready: true, restart count 2 Mar 19 04:37:02.394: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container mock ready: true, restart count 0 Mar 19 04:37:02.394: INFO: coredns-8f5847b64-cb89d started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container coredns ready: true, restart count 0 Mar 19 04:37:02.394: INFO: l7-default-backend-856d874f49-9wsfv started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container default-http-backend ready: true, restart count 0 Mar 19 04:37:02.394: INFO: konnectivity-agent-m2cxq started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:37:02.394: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:36:35 +0000 UTC (0+7 container statuses recorded) Mar 19 04:37:02.394: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:37:02.394: INFO: up-down-2-kxbkc started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:37:02.394: INFO: webserver-pod started at 2023-03-19 04:33:30 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container agnhost ready: false, restart count 0 Mar 19 04:37:02.394: INFO: affinity-nodeport-timeout-6wczq started at 2023-03-19 04:35:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Mar 19 04:37:02.394: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-2nnfx started at 2023-03-19 04:36:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:37:02.394: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:36:51 +0000 UTC (0+7 container statuses recorded) Mar 19 04:37:02.394: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:37:02.394: INFO: pod-subpath-test-dynamicpv-jm2s started at 2023-03-19 04:36:54 +0000 UTC (2+2 container statuses recorded) Mar 19 04:37:02.394: INFO: Init container init-volume-dynamicpv-jm2s ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Init container test-init-subpath-dynamicpv-jm2s ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container test-container-subpath-dynamicpv-jm2s ready: false, restart count 0 Mar 19 04:37:02.394: INFO: Container test-container-volume-dynamicpv-jm2s ready: false, restart count 0 Mar 19 04:37:02.394: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:35:27 +0000 UTC (0+7 container statuses recorded) Mar 19 04:37:02.394: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:37:02.394: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:37:02.394: INFO: kube-dns-autoscaler-7b444c59c9-28g2s started at 2023-03-19 04:31:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container autoscaler ready: true, restart count 0 Mar 19 04:37:02.394: INFO: netserver-2 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:37:02.394: INFO: Container webserver ready: true, restart count 0 Mar 19 04:37:02.801: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-rx1t END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:37:02.801 (2.59s) < Exit [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - dump namespaces | framework.go:209 @ 03/19/23 04:37:02.801 (2.59s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - tear down framework | framework.go:206 @ 03/19/23 04:37:02.801 STEP: Destroying namespace "port-forwarding-2982" for this suite. - test/e2e/framework/framework.go:351 @ 03/19/23 04:37:02.801 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - tear down framework | framework.go:206 @ 03/19/23 04:37:02.856 (56ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:37:02.857 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:37:02.857 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sPort\sforwarding\sWith\sa\sserver\slistening\son\s0\.0\.0\.0\sthat\sexpects\sa\sclient\srequest\sshould\ssupport\sa\sclient\sthat\sconnects\,\ssends\sNO\sDATA\,\sand\sdisconnects$'
[FAILED] Failed to read from kubectl port-forward stdout: EOF In [It] at: test/e2e/kubectl/portforward.go:191 @ 03/19/23 04:43:18.326from junit_01.xml
> Enter [BeforeEach] [sig-cli] Kubectl Port forwarding - set up framework | framework.go:191 @ 03/19/23 04:42:38.506 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/19/23 04:42:38.506 Mar 19 04:42:38.506: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename port-forwarding - test/e2e/framework/framework.go:250 @ 03/19/23 04:42:38.508 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/19/23 04:42:38.913 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/19/23 04:42:39.015 < Exit [BeforeEach] [sig-cli] Kubectl Port forwarding - set up framework | framework.go:191 @ 03/19/23 04:42:39.136 (630ms) > Enter [BeforeEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:42:39.136 < Exit [BeforeEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:42:39.136 (0s) > Enter [It] should support a client that connects, sends NO DATA, and disconnects - test/e2e/kubectl/portforward.go:456 @ 03/19/23 04:42:39.136 STEP: Creating the target pod - test/e2e/kubectl/portforward.go:259 @ 03/19/23 04:42:39.136 STEP: Running 'kubectl port-forward' - test/e2e/kubectl/portforward.go:268 @ 03/19/23 04:42:47.944 Mar 19 04:42:47.944: INFO: starting port-forward command and streaming output Mar 19 04:42:47.944: INFO: Asynchronously running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=port-forwarding-403 port-forward --namespace=port-forwarding-403 pfpod :80' Mar 19 04:42:47.945: INFO: reading from `kubectl port-forward` command's stdout [FAILED] Failed to read from kubectl port-forward stdout: EOF In [It] at: test/e2e/kubectl/portforward.go:191 @ 03/19/23 04:43:18.326 < Exit [It] should support a client that connects, sends NO DATA, and disconnects - test/e2e/kubectl/portforward.go:456 @ 03/19/23 04:43:18.327 (39.19s) > Enter [AfterEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:43:18.327 Mar 19 04:43:18.327: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:43:18.424 (98ms) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:43:18.424 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:43:18.424 (0s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - dump namespaces | framework.go:209 @ 03/19/23 04:43:18.424 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:43:18.424 STEP: Collecting events from namespace "port-forwarding-403". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:43:18.424 STEP: Found 7 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:43:18.468 Mar 19 04:43:18.468: INFO: At 2023-03-19 04:42:39 +0000 UTC - event for pfpod: {default-scheduler } Scheduled: Successfully assigned port-forwarding-403/pfpod to e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:43:18.468: INFO: At 2023-03-19 04:42:41 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 19 04:43:18.468: INFO: At 2023-03-19 04:42:41 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Created: Created container readiness Mar 19 04:43:18.468: INFO: At 2023-03-19 04:42:41 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Started: Started container readiness Mar 19 04:43:18.468: INFO: At 2023-03-19 04:42:41 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 19 04:43:18.468: INFO: At 2023-03-19 04:42:41 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Created: Created container portforwardtester Mar 19 04:43:18.468: INFO: At 2023-03-19 04:42:41 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Started: Started container portforwardtester Mar 19 04:43:18.513: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:43:18.513: INFO: pfpod e2e-c595d7501c-674b9-minion-group-rx1t Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:42:39 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:42:46 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:42:46 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:42:39 +0000 UTC }] Mar 19 04:43:18.513: INFO: Mar 19 04:43:18.682: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:43:18.729: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 28195 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:40:10 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:43:18.729: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:43:18.780: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:43:18.834: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:18.834: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:43:18.834: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:18.834: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:43:18.834: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:18.834: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:43:18.834: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:18.834: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:43:18.834: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:18.834: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:43:18.834: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:18.834: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:43:18.834: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:18.834: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:43:18.834: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:18.834: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:43:18.834: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:43:18.834: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:43:18.834: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:43:19.079: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:43:19.079: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:43:19.128: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 33459 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5456":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:38:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:42:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:42:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:42:45 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:42:45 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:42:45 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:42:45 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5456^7b735b39-c610-11ed-83fd-8220645a41cb kubernetes.io/csi/csi-hostpath-ephemeral-5456^7b7383b1-c610-11ed-83fd-8220645a41cb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5456^7b7383b1-c610-11ed-83fd-8220645a41cb,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5456^7b735b39-c610-11ed-83fd-8220645a41cb,DevicePath:,},},Config:nil,},} Mar 19 04:43:19.128: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:43:19.174: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:43:19.271: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:43:19.271: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:43:19.271: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:43:19.271: INFO: slow-terminating-unready-pod-sr2cb started at 2023-03-19 04:42:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container slow-terminating-unready-pod ready: false, restart count 0 Mar 19 04:43:19.271: INFO: inline-volume-tester-pfpx4 started at 2023-03-19 04:42:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:43:19.271: INFO: execpod-noendpointstdb57 started at 2023-03-19 04:42:54 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:43:19.271: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:43:19.271: INFO: execpodfc6cc started at 2023-03-19 04:41:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:43:19.271: INFO: busybox-82c974fa-a1fc-45e6-887c-60a8238581f0 started at 2023-03-19 04:42:19 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container busybox ready: true, restart count 0 Mar 19 04:43:19.271: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:42:37 +0000 UTC (0+7 container statuses recorded) Mar 19 04:43:19.271: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:43:19.271: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:43:19.271: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:43:19.271: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:43:19.271: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:43:19.271: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:43:19.271: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:43:19.271: INFO: host-test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:43:19.271: INFO: netserver-0 started at 2023-03-19 04:39:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:19.271: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container httpd ready: true, restart count 0 Mar 19 04:43:19.271: INFO: test-pod-94531b2d-68ec-45e2-92aa-16750a24f489 started at 2023-03-19 04:43:18 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container agnhost-container ready: false, restart count 0 Mar 19 04:43:19.271: INFO: test-container-pod started at 2023-03-19 04:40:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:19.271: INFO: pod-terminate-status-2-14 started at 2023-03-19 04:43:16 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container fail ready: false, restart count 0 Mar 19 04:43:19.271: INFO: agnhost started at 2023-03-19 04:42:47 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:43:19.271: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:43:19.271: INFO: nodeport-update-service-c2bvf started at 2023-03-19 04:42:36 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container nodeport-update-service ready: true, restart count 0 Mar 19 04:43:19.271: INFO: test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:19.271: INFO: netserver-0 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:19.271: INFO: pod2 started at 2023-03-19 04:41:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:43:19.271: INFO: netserver-0 started at 2023-03-19 04:40:47 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:19.271: INFO: affinity-nodeport-transition-hlg9n started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:43:19.271: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:43:19.271: INFO: hostpathsymlink-client started at 2023-03-19 04:42:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container hostpathsymlink-client ready: true, restart count 0 Mar 19 04:43:19.271: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:43:19.271: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:43:19.271: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:43:19.271: INFO: rs-9s7lk started at 2023-03-19 04:41:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container donothing ready: false, restart count 0 Mar 19 04:43:19.271: INFO: pod-terminate-status-0-13 started at 2023-03-19 04:43:18 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container fail ready: false, restart count 0 Mar 19 04:43:19.271: INFO: pod-should-be-evictedbe047047-3184-4001-8724-123965655a44 started at 2023-03-19 04:42:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.271: INFO: Container bar ready: true, restart count 0 Mar 19 04:43:19.805: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:43:19.805: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:43:19.850: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 32116 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-2079":"csi-mock-csi-mock-volumes-expansion-2079"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:38:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:41:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:41:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2079^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2079^4,DevicePath:,},},Config:nil,},} Mar 19 04:43:19.850: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:43:19.898: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:43:19.990: INFO: netserver-1 started at 2023-03-19 04:40:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:19.990: INFO: npd-v0.8.9-xn47l started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:43:19.990: INFO: csi-mockplugin-0 started at 2023-03-19 04:40:03 +0000 UTC (0+4 container statuses recorded) Mar 19 04:43:19.990: INFO: Container busybox ready: true, restart count 0 Mar 19 04:43:19.990: INFO: Container csi-provisioner ready: true, restart count 4 Mar 19 04:43:19.990: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:43:19.990: INFO: Container mock ready: true, restart count 0 Mar 19 04:43:19.990: INFO: inline-volume-tester2-bdwxn started at 2023-03-19 04:37:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:43:19.990: INFO: netserver-1 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:19.990: INFO: pod1 started at 2023-03-19 04:41:44 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:43:19.990: INFO: netserver-1 started at 2023-03-19 04:39:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:19.990: INFO: test-container-pod started at 2023-03-19 04:40:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:19.990: INFO: pod-configmaps-5751adaa-0a43-41c5-9eca-1bff7641efeb started at 2023-03-19 04:43:13 +0000 UTC (0+2 container statuses recorded) Mar 19 04:43:19.990: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:43:19.990: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 19 04:43:19.990: INFO: pod-terminate-status-1-13 started at 2023-03-19 04:43:17 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container fail ready: false, restart count 0 Mar 19 04:43:19.990: INFO: metadata-proxy-v0.1-bxcx5 started at 2023-03-19 04:28:34 +0000 UTC (0+2 container statuses recorded) Mar 19 04:43:19.990: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:43:19.990: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:43:19.990: INFO: konnectivity-agent-n8mzc started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:43:19.990: INFO: csi-mockplugin-0 started at 2023-03-19 04:42:12 +0000 UTC (0+4 container statuses recorded) Mar 19 04:43:19.990: INFO: Container busybox ready: true, restart count 0 Mar 19 04:43:19.990: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:43:19.990: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:43:19.990: INFO: Container mock ready: true, restart count 0 Mar 19 04:43:19.990: INFO: netserver-1 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:19.990: INFO: pod-ephm-test-projected-b54h started at 2023-03-19 04:42:05 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container test-container-subpath-projected-b54h ready: false, restart count 0 Mar 19 04:43:19.990: INFO: coredns-8f5847b64-rzgwn started at 2023-03-19 04:28:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container coredns ready: true, restart count 0 Mar 19 04:43:19.990: INFO: affinity-nodeport-transition-q8wrj started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:43:19.990: INFO: pvc-volume-tester-m9fn8 started at 2023-03-19 04:41:55 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container volume-tester ready: false, restart count 0 Mar 19 04:43:19.990: INFO: execpods68sv started at 2023-03-19 04:42:40 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:43:19.990: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:41:11 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:43:19.990: INFO: csi-mockplugin-0 started at 2023-03-19 04:41:11 +0000 UTC (0+4 container statuses recorded) Mar 19 04:43:19.990: INFO: Container busybox ready: true, restart count 0 Mar 19 04:43:19.990: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:43:19.990: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:43:19.990: INFO: Container mock ready: true, restart count 0 Mar 19 04:43:19.990: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-kd0v started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:19.990: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:43:20.331: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:43:20.331: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:43:20.377: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-rx1t 81031ff0-6ac7-4503-8384-dada37cf30f8 32487 0 2023-03-19 04:28:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-rx1t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-rx1t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2023-03-19 04:38:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:39:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-19 04:41:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-rx1t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.10.228,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:515db57784a9c6bd89ce17868c72021b,SystemUUID:515db577-84a9-c6bd-89ce-17868c72021b,BootID:744f3d9d-8dea-4311-872e-96785d8e8169,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:43:20.377: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:43:20.421: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:43:20.487: INFO: nodeport-update-service-fd9jp started at 2023-03-19 04:42:36 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container nodeport-update-service ready: true, restart count 0 Mar 19 04:43:20.487: INFO: netserver-2 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:20.487: INFO: test-container-pod started at 2023-03-19 04:39:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:20.487: INFO: affinity-nodeport-transition-ffkwt started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:43:20.487: INFO: execpod-affinityxk5sg started at 2023-03-19 04:42:37 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:43:20.487: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-kf55t started at 2023-03-19 04:42:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:43:20.487: INFO: csi-mockplugin-0 started at 2023-03-19 04:40:03 +0000 UTC (0+4 container statuses recorded) Mar 19 04:43:20.487: INFO: Container busybox ready: true, restart count 0 Mar 19 04:43:20.487: INFO: Container csi-provisioner ready: true, restart count 4 Mar 19 04:43:20.487: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:43:20.487: INFO: Container mock ready: true, restart count 0 Mar 19 04:43:20.487: INFO: netserver-2 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:20.487: INFO: netserver-2 started at 2023-03-19 04:39:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:20.487: INFO: dns-test-b8d8f3d8-6484-4765-9420-aaef29a5473f started at 2023-03-19 04:43:04 +0000 UTC (0+3 container statuses recorded) Mar 19 04:43:20.487: INFO: Container jessie-querier ready: true, restart count 0 Mar 19 04:43:20.487: INFO: Container querier ready: true, restart count 0 Mar 19 04:43:20.487: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:20.487: INFO: kube-dns-autoscaler-7b444c59c9-28g2s started at 2023-03-19 04:31:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container autoscaler ready: true, restart count 0 Mar 19 04:43:20.487: INFO: npd-v0.8.9-j2c8h started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:43:20.487: INFO: proxy-service-gv2gz-m7wkr started at 2023-03-19 04:42:39 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container proxy-service-gv2gz ready: true, restart count 0 Mar 19 04:43:20.487: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-rx1t started at 2023-03-19 04:28:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:43:20.487: INFO: volume-snapshot-controller-0 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container volume-snapshot-controller ready: true, restart count 0 Mar 19 04:43:20.487: INFO: pfpod started at 2023-03-19 04:42:39 +0000 UTC (0+2 container statuses recorded) Mar 19 04:43:20.487: INFO: Container portforwardtester ready: true, restart count 0 Mar 19 04:43:20.487: INFO: Container readiness ready: true, restart count 0 Mar 19 04:43:20.487: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:40:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container csi-attacher ready: true, restart count 4 Mar 19 04:43:20.487: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:40:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container csi-resizer ready: false, restart count 4 Mar 19 04:43:20.487: INFO: metadata-proxy-v0.1-tlkct started at 2023-03-19 04:28:35 +0000 UTC (0+2 container statuses recorded) Mar 19 04:43:20.487: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:43:20.487: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:43:20.487: INFO: coredns-8f5847b64-cb89d started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container coredns ready: true, restart count 0 Mar 19 04:43:20.487: INFO: l7-default-backend-856d874f49-9wsfv started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container default-http-backend ready: true, restart count 0 Mar 19 04:43:20.487: INFO: konnectivity-agent-m2cxq started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:43:20.487: INFO: pod-subpath-test-preprovisionedpv-k759 started at 2023-03-19 04:42:58 +0000 UTC (1+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Init container init-volume-preprovisionedpv-k759 ready: true, restart count 0 Mar 19 04:43:20.487: INFO: Container test-container-subpath-preprovisionedpv-k759 ready: true, restart count 0 Mar 19 04:43:20.487: INFO: execpod-gf29b started at 2023-03-19 04:42:05 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:43:20.487: INFO: netserver-2 started at 2023-03-19 04:40:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:43:20.487: INFO: Container webserver ready: true, restart count 0 Mar 19 04:43:20.783: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-rx1t END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:43:20.783 (2.358s) < Exit [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - dump namespaces | framework.go:209 @ 03/19/23 04:43:20.783 (2.358s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - tear down framework | framework.go:206 @ 03/19/23 04:43:20.783 STEP: Destroying namespace "port-forwarding-403" for this suite. - test/e2e/framework/framework.go:351 @ 03/19/23 04:43:20.783 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - tear down framework | framework.go:206 @ 03/19/23 04:43:20.83 (47ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:43:20.83 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:43:20.83 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sPort\sforwarding\sWith\sa\sserver\slistening\son\slocalhost\sthat\sexpects\sa\sclient\srequest\sshould\ssupport\sa\sclient\sthat\sconnects\,\ssends\sNO\sDATA\,\sand\sdisconnects$'
[FAILED] Failed to read from kubectl port-forward stdout: EOF In [It] at: test/e2e/kubectl/portforward.go:191 @ 03/19/23 04:38:06.209from junit_01.xml
> Enter [BeforeEach] [sig-cli] Kubectl Port forwarding - set up framework | framework.go:191 @ 03/19/23 04:37:27.059 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/19/23 04:37:27.059 Mar 19 04:37:27.059: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename port-forwarding - test/e2e/framework/framework.go:250 @ 03/19/23 04:37:27.06 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/19/23 04:37:27.243 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/19/23 04:37:27.353 < Exit [BeforeEach] [sig-cli] Kubectl Port forwarding - set up framework | framework.go:191 @ 03/19/23 04:37:27.439 (381ms) > Enter [BeforeEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:37:27.439 < Exit [BeforeEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:37:27.44 (0s) > Enter [It] should support a client that connects, sends NO DATA, and disconnects - test/e2e/kubectl/portforward.go:478 @ 03/19/23 04:37:27.44 STEP: Creating the target pod - test/e2e/kubectl/portforward.go:259 @ 03/19/23 04:37:27.44 STEP: Running 'kubectl port-forward' - test/e2e/kubectl/portforward.go:268 @ 03/19/23 04:37:35.833 Mar 19 04:37:35.833: INFO: starting port-forward command and streaming output Mar 19 04:37:35.833: INFO: Asynchronously running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=port-forwarding-3293 port-forward --namespace=port-forwarding-3293 pfpod :80' Mar 19 04:37:35.833: INFO: reading from `kubectl port-forward` command's stdout [FAILED] Failed to read from kubectl port-forward stdout: EOF In [It] at: test/e2e/kubectl/portforward.go:191 @ 03/19/23 04:38:06.209 < Exit [It] should support a client that connects, sends NO DATA, and disconnects - test/e2e/kubectl/portforward.go:478 @ 03/19/23 04:38:06.209 (38.769s) > Enter [AfterEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:38:06.209 Mar 19 04:38:06.209: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cli] Kubectl Port forwarding - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:38:06.296 (87ms) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:38:06.296 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:38:06.296 (0s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - dump namespaces | framework.go:209 @ 03/19/23 04:38:06.296 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:38:06.296 STEP: Collecting events from namespace "port-forwarding-3293". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:38:06.296 STEP: Found 7 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:38:06.341 Mar 19 04:38:06.341: INFO: At 2023-03-19 04:37:27 +0000 UTC - event for pfpod: {default-scheduler } Scheduled: Successfully assigned port-forwarding-3293/pfpod to e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:38:06.341: INFO: At 2023-03-19 04:37:28 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 19 04:38:06.341: INFO: At 2023-03-19 04:37:28 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Created: Created container readiness Mar 19 04:38:06.341: INFO: At 2023-03-19 04:37:28 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Started: Started container readiness Mar 19 04:38:06.341: INFO: At 2023-03-19 04:37:28 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 19 04:38:06.341: INFO: At 2023-03-19 04:37:28 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Created: Created container portforwardtester Mar 19 04:38:06.341: INFO: At 2023-03-19 04:37:28 +0000 UTC - event for pfpod: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Started: Started container portforwardtester Mar 19 04:38:06.384: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:38:06.384: INFO: pfpod e2e-c595d7501c-674b9-minion-group-kd0v Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:37:27 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:37:33 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:37:33 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-19 04:37:27 +0000 UTC }] Mar 19 04:38:06.384: INFO: Mar 19 04:38:06.546: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:38:06.593: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 15766 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:35:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:38:06.593: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:38:06.642: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:38:06.710: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:06.710: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:38:06.710: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:06.710: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:38:06.710: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:06.710: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:38:06.710: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:06.710: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:38:06.710: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:38:06.710: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:06.710: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:38:06.710: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:06.710: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:38:06.710: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:06.710: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:38:06.710: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:06.710: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:38:06.710: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:06.710: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:38:06.973: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:38:06.973: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:38:07.037: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 23058 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-6328":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:33:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:37:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:37:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:37:47 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:37:47 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:37:47 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:37:47 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-6328^c9d10e97-c60f-11ed-bc0f-4693c08b5b5c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-6328^c9d10e97-c60f-11ed-bc0f-4693c08b5b5c,DevicePath:,},},Config:nil,},} Mar 19 04:38:07.038: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:38:07.087: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:38:07.212: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:38:07.212: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:07.212: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:38:07.212: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:38:07.212: INFO: external-provisioner-pv685 started at 2023-03-19 04:37:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:38:07.212: INFO: sysctl-296a6dd4-ca53-4177-971a-3cc0c9a66e64 started at 2023-03-19 04:38:01 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container test-container ready: false, restart count 0 Mar 19 04:38:07.212: INFO: pod2 started at 2023-03-19 04:37:06 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:38:07.212: INFO: pfpod started at 2023-03-19 04:38:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:07.212: INFO: Container portforwardtester ready: true, restart count 0 Mar 19 04:38:07.212: INFO: Container readiness ready: true, restart count 0 Mar 19 04:38:07.212: INFO: pod-logs-websocket-d5d859f8-637f-4a8c-bbc0-3007cc7855c5 started at 2023-03-19 04:37:58 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container main ready: true, restart count 0 Mar 19 04:38:07.212: INFO: e2e-host-exec started at 2023-03-19 04:37:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container e2e-host-exec ready: true, restart count 0 Mar 19 04:38:07.212: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:37:40 +0000 UTC (0+7 container statuses recorded) Mar 19 04:38:07.212: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:38:07.212: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:38:07.212: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:38:07.212: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:38:07.212: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:38:07.212: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:38:07.212: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:38:07.212: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:38:07.212: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:07.212: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:38:07.212: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:38:07.212: INFO: pause-pod-5dd8776d-q64bs started at 2023-03-19 04:37:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container agnhost-pause ready: true, restart count 0 Mar 19 04:38:07.212: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-z96jw started at 2023-03-19 04:37:11 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:38:07.212: INFO: pod3 started at 2023-03-19 04:37:08 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:38:07.212: INFO: ss2-1 started at 2023-03-19 04:37:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:07.212: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container httpd ready: true, restart count 0 Mar 19 04:38:07.212: INFO: up-down-2-hl7bg started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:38:07.212: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:38:07.212: INFO: external-provisioner-pj725 started at 2023-03-19 04:38:06 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container nfs-provisioner ready: false, restart count 0 Mar 19 04:38:07.212: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-ghvp7 started at 2023-03-19 04:37:32 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:38:07.212: INFO: pod-a2ba73be-63be-4b87-a7c0-93af4f512b4c started at 2023-03-19 04:37:37 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:38:07.212: INFO: test-webserver-92bef116-fc7a-4dc1-91c0-556f7cb58af5 started at 2023-03-19 04:35:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container test-webserver ready: true, restart count 0 Mar 19 04:38:07.212: INFO: netserver-0 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:07.212: INFO: netserver-0 started at 2023-03-19 04:37:24 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:07.212: INFO: pod1 started at 2023-03-19 04:37:04 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.212: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:38:07.736: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:38:07.736: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:38:07.788: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 21956 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7282":"e2e-c595d7501c-674b9-minion-group-kd0v"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:33:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:36:23 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-19 04:37:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:37:08 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:37:08 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:37:08 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:37:08 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:38:07.788: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:38:07.832: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:38:07.965: INFO: konnectivity-agent-n8mzc started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.965: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:38:07.965: INFO: verify-service-up-exec-pod-znpd4 started at 2023-03-19 04:37:40 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.965: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:38:07.965: INFO: test-grpc-0b6aa968-1734-475e-8787-92e57c84a6b9 started at 2023-03-19 04:37:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.965: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:38:07.965: INFO: up-down-2-xg9nt started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.965: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:38:07.965: INFO: test-container-pod started at 2023-03-19 04:37:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.965: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:07.965: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-5fr5j started at 2023-03-19 04:37:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.965: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:38:07.965: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-5xd4g started at 2023-03-19 04:38:06 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.965: INFO: Container agnhost-container ready: false, restart count 0 Mar 19 04:38:07.965: INFO: coredns-8f5847b64-rzgwn started at 2023-03-19 04:28:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.965: INFO: Container coredns ready: true, restart count 0 Mar 19 04:38:07.965: INFO: webserver-pod started at 2023-03-19 04:33:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.965: INFO: Container agnhost ready: false, restart count 0 Mar 19 04:38:07.965: INFO: netserver-1 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.965: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:07.965: INFO: test-container-pod started at 2023-03-19 04:36:18 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:07.966: INFO: busybox-ffa775c5-85ed-4aae-bfd2-1bfc0600797d started at 2023-03-19 04:37:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container busybox ready: false, restart count 0 Mar 19 04:38:07.966: INFO: netserver-1 started at 2023-03-19 04:37:24 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:07.966: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:37:23 +0000 UTC (0+7 container statuses recorded) Mar 19 04:38:07.966: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:38:07.966: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:38:07.966: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:38:07.966: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:38:07.966: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:38:07.966: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:38:07.966: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:38:07.966: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-kd0v started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:38:07.966: INFO: ss2-0 started at 2023-03-19 04:37:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:07.966: INFO: test-grpc-828f8ba9-bb1f-4f6b-aa50-4b0805b20bb6 started at 2023-03-19 04:37:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:38:07.966: INFO: verify-service-up-host-exec-pod started at 2023-03-19 04:37:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:38:07.966: INFO: npd-v0.8.9-xn47l started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:38:07.966: INFO: test-webserver-e6849690-48dd-4d6b-a949-432c4f5cff60 started at 2023-03-19 04:37:12 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container test-webserver ready: false, restart count 0 Mar 19 04:38:07.966: INFO: pause-pod-5dd8776d-nxss7 started at 2023-03-19 04:37:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container agnhost-pause ready: true, restart count 0 Mar 19 04:38:07.966: INFO: pfpod started at 2023-03-19 04:37:27 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:07.966: INFO: Container portforwardtester ready: true, restart count 0 Mar 19 04:38:07.966: INFO: Container readiness ready: true, restart count 0 Mar 19 04:38:07.966: INFO: inline-volume-tester-zkzhs started at 2023-03-19 04:37:12 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:38:07.966: INFO: inline-volume-tester2-bdwxn started at 2023-03-19 04:37:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:38:07.966: INFO: inline-volume-tester-gglns started at 2023-03-19 04:37:23 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:38:07.966: INFO: echo-sourceip started at 2023-03-19 04:37:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:38:07.966: INFO: metadata-proxy-v0.1-bxcx5 started at 2023-03-19 04:28:34 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:07.966: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:38:07.966: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:38:07.966: INFO: external-provisioner-g9ln4 started at 2023-03-19 04:37:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:07.966: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:38:08.280: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:38:08.280: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:38:08.324: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-rx1t 81031ff0-6ac7-4503-8384-dada37cf30f8 23324 0 2023-03-19 04:28:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-rx1t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-rx1t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2762":"e2e-c595d7501c-674b9-minion-group-rx1t","csi-hostpath-ephemeral-5495":"e2e-c595d7501c-674b9-minion-group-rx1t","csi-mock-csi-mock-volumes-service-token-6397":"e2e-c595d7501c-674b9-minion-group-rx1t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2023-03-19 04:33:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:37:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:38:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-rx1t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:33:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:37:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:37:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:37:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:37:58 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.10.228,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:515db57784a9c6bd89ce17868c72021b,SystemUUID:515db577-84a9-c6bd-89ce-17868c72021b,BootID:744f3d9d-8dea-4311-872e-96785d8e8169,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2762^a2fb09c0-c60f-11ed-9a1c-def901249bfc kubernetes.io/csi/csi-hostpath-ephemeral-5495^c469cff7-c60f-11ed-86a9-06fa571b42aa],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5495^c469cff7-c60f-11ed-86a9-06fa571b42aa,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2762^a2fb09c0-c60f-11ed-9a1c-def901249bfc,DevicePath:,},},Config:nil,},} Mar 19 04:38:08.325: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:38:08.369: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:38:08.425: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:37:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:38:08.425: INFO: ss2-2 started at 2023-03-19 04:37:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:08.425: INFO: csi-mockplugin-0 started at 2023-03-19 04:37:34 +0000 UTC (0+3 container statuses recorded) Mar 19 04:38:08.425: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container mock ready: true, restart count 0 Mar 19 04:38:08.425: INFO: kube-dns-autoscaler-7b444c59c9-28g2s started at 2023-03-19 04:31:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container autoscaler ready: true, restart count 0 Mar 19 04:38:08.425: INFO: netserver-2 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:08.425: INFO: npd-v0.8.9-j2c8h started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:38:08.425: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-rx1t started at 2023-03-19 04:28:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:38:08.425: INFO: inline-volume-tester-zr8ql started at 2023-03-19 04:36:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:38:08.425: INFO: volume-snapshot-controller-0 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container volume-snapshot-controller ready: true, restart count 0 Mar 19 04:38:08.425: INFO: metadata-proxy-v0.1-tlkct started at 2023-03-19 04:28:35 +0000 UTC (0+2 container statuses recorded) Mar 19 04:38:08.425: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:38:08.425: INFO: csi-mockplugin-0 started at 2023-03-19 04:35:59 +0000 UTC (0+4 container statuses recorded) Mar 19 04:38:08.425: INFO: Container busybox ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container csi-provisioner ready: false, restart count 3 Mar 19 04:38:08.425: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container mock ready: true, restart count 0 Mar 19 04:38:08.425: INFO: coredns-8f5847b64-cb89d started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container coredns ready: true, restart count 0 Mar 19 04:38:08.425: INFO: l7-default-backend-856d874f49-9wsfv started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container default-http-backend ready: true, restart count 0 Mar 19 04:38:08.425: INFO: konnectivity-agent-m2cxq started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:38:08.425: INFO: netserver-2 started at 2023-03-19 04:37:24 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container webserver ready: true, restart count 0 Mar 19 04:38:08.425: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:36:35 +0000 UTC (0+7 container statuses recorded) Mar 19 04:38:08.425: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:38:08.425: INFO: up-down-2-kxbkc started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:38:08.425: INFO: inline-volume-tester-f4z97 started at 2023-03-19 04:37:37 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:38:08.425: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:37:30 +0000 UTC (0+7 container statuses recorded) Mar 19 04:38:08.425: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:38:08.425: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:38:08.425: INFO: webserver-pod started at 2023-03-19 04:33:30 +0000 UTC (0+1 container statuses recorded) Mar 19 04:38:08.425: INFO: Container agnhost ready: false, restart count 0 Mar 19 04:38:08.730: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-rx1t END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:38:08.73 (2.434s) < Exit [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - dump namespaces | framework.go:209 @ 03/19/23 04:38:08.73 (2.434s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - tear down framework | framework.go:206 @ 03/19/23 04:38:08.73 STEP: Destroying namespace "port-forwarding-3293" for this suite. - test/e2e/framework/framework.go:351 @ 03/19/23 04:38:08.73 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding - tear down framework | framework.go:206 @ 03/19/23 04:38:08.775 (45ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:38:08.775 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:38:08.775 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sKubectl\scopy\sshould\scopy\sa\sfile\sfrom\sa\srunning\sPod$'
[FAILED] error running /go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-984 cp busybox1:/root/foo/bar/foo.bar /tmp/copy-foobar3529148361: Command stdout: stderr: Error from server: error dialing backend: dial timeout, backstop error: exit status 1 In [It] at: test/e2e/framework/kubectl/builder.go:87 @ 03/19/23 04:42:41.928from junit_01.xml
> Enter [BeforeEach] [sig-cli] Kubectl client - set up framework | framework.go:191 @ 03/19/23 04:42:08.017 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/19/23 04:42:08.017 Mar 19 04:42:08.017: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename kubectl - test/e2e/framework/framework.go:250 @ 03/19/23 04:42:08.018 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/19/23 04:42:08.166 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/19/23 04:42:08.254 < Exit [BeforeEach] [sig-cli] Kubectl client - set up framework | framework.go:191 @ 03/19/23 04:42:08.342 (324ms) > Enter [BeforeEach] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:42:08.342 < Exit [BeforeEach] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:42:08.342 (0s) > Enter [BeforeEach] [sig-cli] Kubectl client - test/e2e/kubectl/kubectl.go:276 @ 03/19/23 04:42:08.342 < Exit [BeforeEach] [sig-cli] Kubectl client - test/e2e/kubectl/kubectl.go:276 @ 03/19/23 04:42:08.342 (0s) > Enter [BeforeEach] Kubectl copy - test/e2e/kubectl/kubectl.go:1598 @ 03/19/23 04:42:08.342 STEP: creating the pod - test/e2e/kubectl/kubectl.go:1599 @ 03/19/23 04:42:08.342 Mar 19 04:42:08.342: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-984 create -f -' Mar 19 04:42:09.458: INFO: stderr: "" Mar 19 04:42:09.458: INFO: stdout: "pod/busybox1 created\n" < Exit [BeforeEach] Kubectl copy - test/e2e/kubectl/kubectl.go:1598 @ 03/19/23 04:42:11.565 (3.223s) > Enter [It] should copy a file from a running Pod - test/e2e/kubectl/kubectl.go:1613 @ 03/19/23 04:42:11.565 STEP: specifying a remote filepath busybox1:/root/foo/bar/foo.bar on the pod - test/e2e/kubectl/kubectl.go:1621 @ 03/19/23 04:42:11.565 Mar 19 04:42:11.565: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-984 cp busybox1:/root/foo/bar/foo.bar /tmp/copy-foobar3529148361' Mar 19 04:42:41.928: INFO: rc: 1 Mar 19 04:42:41.928: INFO: Unexpected error: <exec.CodeExitError>: error running /go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-984 cp busybox1:/root/foo/bar/foo.bar /tmp/copy-foobar3529148361: Command stdout: stderr: Error from server: error dialing backend: dial timeout, backstop error: exit status 1 { Err: <*errors.errorString | 0xc005154060>{ s: "error running /go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-984 cp busybox1:/root/foo/bar/foo.bar /tmp/copy-foobar3529148361:\nCommand stdout:\n\nstderr:\nError from server: error dialing backend: dial timeout, backstop\n\nerror:\nexit status 1", }, Code: 1, } [FAILED] error running /go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-984 cp busybox1:/root/foo/bar/foo.bar /tmp/copy-foobar3529148361: Command stdout: stderr: Error from server: error dialing backend: dial timeout, backstop error: exit status 1 In [It] at: test/e2e/framework/kubectl/builder.go:87 @ 03/19/23 04:42:41.928 < Exit [It] should copy a file from a running Pod - test/e2e/kubectl/kubectl.go:1613 @ 03/19/23 04:42:41.928 (30.364s) > Enter [AfterEach] Kubectl copy - test/e2e/kubectl/kubectl.go:1604 @ 03/19/23 04:42:41.928 STEP: using delete to clean up resources - test/e2e/kubectl/kubectl.go:200 @ 03/19/23 04:42:41.928 Mar 19 04:42:41.928: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-984 delete --grace-period=0 --force -f -' Mar 19 04:42:42.611: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Mar 19 04:42:42.611: INFO: stdout: "pod \"busybox1\" force deleted\n" Mar 19 04:42:42.611: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-984 get rc,svc -l app=busybox1 --no-headers' Mar 19 04:42:42.993: INFO: stderr: "No resources found in kubectl-984 namespace.\n" Mar 19 04:42:42.993: INFO: stdout: "" Mar 19 04:42:42.993: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-984 get pods -l app=busybox1 -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Mar 19 04:42:43.249: INFO: stderr: "" Mar 19 04:42:43.249: INFO: stdout: "" < Exit [AfterEach] Kubectl copy - test/e2e/kubectl/kubectl.go:1604 @ 03/19/23 04:42:43.249 (1.321s) > Enter [AfterEach] [sig-cli] Kubectl client - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:42:43.249 Mar 19 04:42:43.249: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cli] Kubectl client - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:42:43.38 (131ms) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:42:43.38 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:42:43.38 (0s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - dump namespaces | framework.go:209 @ 03/19/23 04:42:43.38 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:42:43.38 STEP: Collecting events from namespace "kubectl-984". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:42:43.38 STEP: Found 5 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:42:43.494 Mar 19 04:42:43.494: INFO: At 2023-03-19 04:42:09 +0000 UTC - event for busybox1: {default-scheduler } Scheduled: Successfully assigned kubectl-984/busybox1 to e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:42:43.494: INFO: At 2023-03-19 04:42:10 +0000 UTC - event for busybox1: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 19 04:42:43.494: INFO: At 2023-03-19 04:42:10 +0000 UTC - event for busybox1: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} Created: Created container busybox Mar 19 04:42:43.494: INFO: At 2023-03-19 04:42:10 +0000 UTC - event for busybox1: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} Started: Started container busybox Mar 19 04:42:43.494: INFO: At 2023-03-19 04:42:42 +0000 UTC - event for busybox1: {kubelet e2e-c595d7501c-674b9-minion-group-gmd9} Killing: Stopping container busybox Mar 19 04:42:43.590: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:42:43.590: INFO: Mar 19 04:42:43.675: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:42:43.763: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 28195 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:40:10 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:42:43.763: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:42:43.846: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:42:43.944: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:43.944: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:42:43.944: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:43.944: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:42:43.944: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:43.944: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:42:43.944: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:43.944: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:42:43.944: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:43.944: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:42:43.944: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:43.944: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:42:43.944: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:43.944: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:42:43.944: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:42:43.944: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:42:43.944: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:42:43.944: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:43.944: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:42:44.196: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:42:44.197: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:42:44.264: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 33407 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5456":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:38:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2023-03-19 04:42:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-03-19 04:42:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:43 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:43 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:43 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:41:43 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5456^7b7383b1-c610-11ed-83fd-8220645a41cb,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5456^7b735b39-c610-11ed-83fd-8220645a41cb,DevicePath:,},},Config:nil,},} Mar 19 04:42:44.264: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:42:44.322: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:42:44.559: INFO: pod-should-be-evictedbe047047-3184-4001-8724-123965655a44 started at 2023-03-19 04:42:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container bar ready: true, restart count 0 Mar 19 04:42:44.559: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:42:44.559: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:42:44.559: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:42:44.559: INFO: slow-terminating-unready-pod-sr2cb started at 2023-03-19 04:42:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container slow-terminating-unready-pod ready: false, restart count 0 Mar 19 04:42:44.559: INFO: inline-volume-tester-pfpx4 started at 2023-03-19 04:42:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:42:44.559: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:42:44.559: INFO: execpodfc6cc started at 2023-03-19 04:41:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:44.559: INFO: pod-terminate-status-0-2 started at 2023-03-19 04:42:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container fail ready: false, restart count 0 Mar 19 04:42:44.559: INFO: busybox-82c974fa-a1fc-45e6-887c-60a8238581f0 started at 2023-03-19 04:42:19 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container busybox ready: true, restart count 0 Mar 19 04:42:44.559: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:42:37 +0000 UTC (0+7 container statuses recorded) Mar 19 04:42:44.559: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:42:44.559: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:42:44.559: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:42:44.559: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:42:44.559: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:42:44.559: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:42:44.559: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:42:44.559: INFO: host-test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:44.559: INFO: netserver-0 started at 2023-03-19 04:39:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:44.559: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container httpd ready: true, restart count 0 Mar 19 04:42:44.559: INFO: test-container-pod started at 2023-03-19 04:40:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:44.559: INFO: pod-terminate-status-2-2 started at 2023-03-19 04:42:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container fail ready: false, restart count 0 Mar 19 04:42:44.559: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:42:44.559: INFO: pod-subpath-test-downwardapi-4fmg started at 2023-03-19 04:42:40 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container test-container-subpath-downwardapi-4fmg ready: true, restart count 0 Mar 19 04:42:44.559: INFO: nodeport-update-service-c2bvf started at 2023-03-19 04:42:36 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container nodeport-update-service ready: true, restart count 0 Mar 19 04:42:44.559: INFO: test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:44.559: INFO: annotationupdated006f5e8-8d68-4ad3-a6ec-8d20c551ff64 started at 2023-03-19 04:42:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container client-container ready: true, restart count 0 Mar 19 04:42:44.559: INFO: netserver-0 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:44.559: INFO: pod2 started at 2023-03-19 04:41:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:44.559: INFO: netserver-0 started at 2023-03-19 04:40:47 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:44.559: INFO: pod-projected-secrets-9f30e18f-4caa-4d28-95f4-b0d389858a47 started at 2023-03-19 04:42:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container secret-volume-test ready: false, restart count 0 Mar 19 04:42:44.559: INFO: affinity-nodeport-transition-hlg9n started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:42:44.559: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:42:44.559: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:42:44.559: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:42:44.559: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:42:44.559: INFO: rs-9s7lk started at 2023-03-19 04:41:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:44.559: INFO: Container donothing ready: false, restart count 0 Mar 19 04:42:45.096: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:42:45.096: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:42:45.167: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 32116 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-2079":"csi-mock-csi-mock-volumes-expansion-2079"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:38:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:41:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:41:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:41:55 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2079^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2079^4,DevicePath:,},},Config:nil,},} Mar 19 04:42:45.167: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:42:45.313: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:42:45.416: INFO: pod-ephm-test-projected-b54h started at 2023-03-19 04:42:05 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container test-container-subpath-projected-b54h ready: false, restart count 0 Mar 19 04:42:45.416: INFO: netserver-1 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:45.416: INFO: coredns-8f5847b64-rzgwn started at 2023-03-19 04:28:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container coredns ready: true, restart count 0 Mar 19 04:42:45.416: INFO: affinity-nodeport-transition-q8wrj started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:42:45.416: INFO: pvc-volume-tester-m9fn8 started at 2023-03-19 04:41:55 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container volume-tester ready: false, restart count 0 Mar 19 04:42:45.416: INFO: execpods68sv started at 2023-03-19 04:42:40 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:45.416: INFO: csi-mockplugin-0 started at 2023-03-19 04:41:11 +0000 UTC (0+4 container statuses recorded) Mar 19 04:42:45.416: INFO: Container busybox ready: true, restart count 0 Mar 19 04:42:45.416: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:42:45.416: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:42:45.416: INFO: Container mock ready: true, restart count 0 Mar 19 04:42:45.416: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:41:11 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:42:45.416: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-kd0v started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:42:45.416: INFO: test-dns-nameservers started at 2023-03-19 04:42:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:45.416: INFO: netserver-1 started at 2023-03-19 04:40:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:45.416: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-5gs56 started at 2023-03-19 04:41:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:45.416: INFO: npd-v0.8.9-xn47l started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:42:45.416: INFO: csi-mockplugin-0 started at 2023-03-19 04:40:03 +0000 UTC (0+4 container statuses recorded) Mar 19 04:42:45.416: INFO: Container busybox ready: true, restart count 0 Mar 19 04:42:45.416: INFO: Container csi-provisioner ready: false, restart count 3 Mar 19 04:42:45.416: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:42:45.416: INFO: Container mock ready: true, restart count 0 Mar 19 04:42:45.416: INFO: webserver-pod started at 2023-03-19 04:40:47 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:45.416: INFO: inline-volume-tester2-bdwxn started at 2023-03-19 04:37:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:42:45.416: INFO: pod1 started at 2023-03-19 04:41:44 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:45.416: INFO: netserver-1 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:45.416: INFO: test-container-pod started at 2023-03-19 04:40:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:45.416: INFO: netserver-1 started at 2023-03-19 04:39:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:45.416: INFO: metadata-proxy-v0.1-bxcx5 started at 2023-03-19 04:28:34 +0000 UTC (0+2 container statuses recorded) Mar 19 04:42:45.416: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:42:45.416: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:42:45.416: INFO: konnectivity-agent-n8mzc started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:45.416: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:42:45.416: INFO: csi-mockplugin-0 started at 2023-03-19 04:42:12 +0000 UTC (0+4 container statuses recorded) Mar 19 04:42:45.416: INFO: Container busybox ready: true, restart count 0 Mar 19 04:42:45.416: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:42:45.416: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:42:45.416: INFO: Container mock ready: true, restart count 0 Mar 19 04:42:45.829: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:42:45.829: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:42:45.894: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-rx1t 81031ff0-6ac7-4503-8384-dada37cf30f8 32487 0 2023-03-19 04:28:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-rx1t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-rx1t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2023-03-19 04:38:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:39:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-19 04:41:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-rx1t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.10.228,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:515db57784a9c6bd89ce17868c72021b,SystemUUID:515db577-84a9-c6bd-89ce-17868c72021b,BootID:744f3d9d-8dea-4311-872e-96785d8e8169,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:42:45.894: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:42:45.965: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:42:46.120: INFO: test-container-pod started at 2023-03-19 04:39:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:46.120: INFO: affinity-nodeport-transition-ffkwt started at 2023-03-19 04:42:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 19 04:42:46.120: INFO: execpod-affinityxk5sg started at 2023-03-19 04:42:37 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:46.120: INFO: csi-mockplugin-0 started at 2023-03-19 04:40:03 +0000 UTC (0+4 container statuses recorded) Mar 19 04:42:46.120: INFO: Container busybox ready: true, restart count 0 Mar 19 04:42:46.120: INFO: Container csi-provisioner ready: false, restart count 3 Mar 19 04:42:46.120: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:42:46.120: INFO: Container mock ready: true, restart count 0 Mar 19 04:42:46.120: INFO: podccebc3e7-2d8a-444d-86bd-efeaa82228f5 started at 2023-03-19 04:42:44 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container nginx ready: true, restart count 0 Mar 19 04:42:46.120: INFO: netserver-2 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:46.120: INFO: netserver-2 started at 2023-03-19 04:39:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:46.120: INFO: kube-dns-autoscaler-7b444c59c9-28g2s started at 2023-03-19 04:31:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container autoscaler ready: true, restart count 0 Mar 19 04:42:46.120: INFO: pod-terminate-status-1-2 started at 2023-03-19 04:42:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container fail ready: false, restart count 0 Mar 19 04:42:46.120: INFO: npd-v0.8.9-j2c8h started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:42:46.120: INFO: proxy-service-gv2gz-m7wkr started at 2023-03-19 04:42:39 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container proxy-service-gv2gz ready: true, restart count 0 Mar 19 04:42:46.120: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-rx1t started at 2023-03-19 04:28:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:42:46.120: INFO: volume-snapshot-controller-0 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container volume-snapshot-controller ready: true, restart count 0 Mar 19 04:42:46.120: INFO: pfpod started at 2023-03-19 04:42:39 +0000 UTC (0+2 container statuses recorded) Mar 19 04:42:46.120: INFO: Container portforwardtester ready: true, restart count 0 Mar 19 04:42:46.120: INFO: Container readiness ready: false, restart count 0 Mar 19 04:42:46.120: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:40:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container csi-attacher ready: false, restart count 3 Mar 19 04:42:46.120: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:40:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container csi-resizer ready: false, restart count 3 Mar 19 04:42:46.120: INFO: metadata-proxy-v0.1-tlkct started at 2023-03-19 04:28:35 +0000 UTC (0+2 container statuses recorded) Mar 19 04:42:46.120: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:42:46.120: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:42:46.120: INFO: coredns-8f5847b64-cb89d started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container coredns ready: true, restart count 0 Mar 19 04:42:46.120: INFO: l7-default-backend-856d874f49-9wsfv started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container default-http-backend ready: true, restart count 0 Mar 19 04:42:46.120: INFO: konnectivity-agent-m2cxq started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:42:46.120: INFO: execpod-gf29b started at 2023-03-19 04:42:05 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:46.120: INFO: pod1 started at 2023-03-19 04:41:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:46.120: INFO: execpodrshxd started at 2023-03-19 04:41:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:42:46.120: INFO: netserver-2 started at 2023-03-19 04:40:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:46.120: INFO: pod-qos-class-d078c60e-d356-450c-acaf-23c99c3ab0e5 started at 2023-03-19 04:42:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:42:46.120: INFO: external-provisioner-7cpwk started at 2023-03-19 04:42:43 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:42:46.120: INFO: nodeport-update-service-fd9jp started at 2023-03-19 04:42:36 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container nodeport-update-service ready: true, restart count 0 Mar 19 04:42:46.120: INFO: netserver-2 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:42:46.120: INFO: Container webserver ready: true, restart count 0 Mar 19 04:42:46.471: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-rx1t END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:42:46.471 (3.09s) < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - dump namespaces | framework.go:209 @ 03/19/23 04:42:46.471 (3.09s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - tear down framework | framework.go:206 @ 03/19/23 04:42:46.471 STEP: Destroying namespace "kubectl-984" for this suite. - test/e2e/framework/framework.go:351 @ 03/19/23 04:42:46.471 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - tear down framework | framework.go:206 @ 03/19/23 04:42:46.516 (45ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:42:46.516 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:42:46.516 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\sreturn\scommand\sexit\scodes\sexecing\sinto\sa\scontainer\swith\sa\sfailing\scommand$'
[FAILED] Expected <int>: 1 to equal <int>: 42 In [It] at: test/e2e/kubectl/kubectl.go:547 @ 03/19/23 04:41:06.941from junit_01.xml
> Enter [BeforeEach] [sig-cli] Kubectl client - set up framework | framework.go:191 @ 03/19/23 04:40:23.312 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/19/23 04:40:23.312 Mar 19 04:40:23.312: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename kubectl - test/e2e/framework/framework.go:250 @ 03/19/23 04:40:23.313 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/19/23 04:40:23.463 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/19/23 04:40:23.547 < Exit [BeforeEach] [sig-cli] Kubectl client - set up framework | framework.go:191 @ 03/19/23 04:40:23.633 (321ms) > Enter [BeforeEach] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:40:23.633 < Exit [BeforeEach] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:40:23.633 (0s) > Enter [BeforeEach] [sig-cli] Kubectl client - test/e2e/kubectl/kubectl.go:276 @ 03/19/23 04:40:23.633 < Exit [BeforeEach] [sig-cli] Kubectl client - test/e2e/kubectl/kubectl.go:276 @ 03/19/23 04:40:23.633 (0s) > Enter [BeforeEach] Simple pod - test/e2e/kubectl/kubectl.go:413 @ 03/19/23 04:40:23.633 STEP: creating the pod from - test/e2e/kubectl/kubectl.go:414 @ 03/19/23 04:40:23.633 Mar 19 04:40:23.633: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-7079 create -f -' Mar 19 04:40:24.212: INFO: stderr: "" Mar 19 04:40:24.212: INFO: stdout: "pod/httpd created\n" < Exit [BeforeEach] Simple pod - test/e2e/kubectl/kubectl.go:413 @ 03/19/23 04:40:36.606 (12.973s) > Enter [It] execing into a container with a failing command - test/e2e/kubectl/kubectl.go:541 @ 03/19/23 04:40:36.606 Mar 19 04:40:36.606: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-7079 exec httpd --pod-running-timeout=2m0s -- /bin/sh -c exit 42' Mar 19 04:41:06.941: INFO: rc: 1 [FAILED] Expected <int>: 1 to equal <int>: 42 In [It] at: test/e2e/kubectl/kubectl.go:547 @ 03/19/23 04:41:06.941 < Exit [It] execing into a container with a failing command - test/e2e/kubectl/kubectl.go:541 @ 03/19/23 04:41:06.941 (30.335s) > Enter [AfterEach] Simple pod - test/e2e/kubectl/kubectl.go:419 @ 03/19/23 04:41:06.941 STEP: using delete to clean up resources - test/e2e/kubectl/kubectl.go:200 @ 03/19/23 04:41:06.941 Mar 19 04:41:06.941: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-7079 delete --grace-period=0 --force -f -' Mar 19 04:41:07.181: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Mar 19 04:41:07.181: INFO: stdout: "pod \"httpd\" force deleted\n" Mar 19 04:41:07.181: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-7079 get rc,svc -l name=httpd --no-headers' Mar 19 04:41:07.437: INFO: stderr: "No resources found in kubectl-7079 namespace.\n" Mar 19 04:41:07.437: INFO: stdout: "" Mar 19 04:41:07.438: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-7079 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Mar 19 04:41:07.723: INFO: stderr: "" Mar 19 04:41:07.723: INFO: stdout: "" < Exit [AfterEach] Simple pod - test/e2e/kubectl/kubectl.go:419 @ 03/19/23 04:41:07.723 (782ms) > Enter [AfterEach] [sig-cli] Kubectl client - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:41:07.723 Mar 19 04:41:07.723: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cli] Kubectl client - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:41:07.86 (137ms) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:41:07.86 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:41:07.861 (0s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - dump namespaces | framework.go:209 @ 03/19/23 04:41:07.861 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:41:07.861 STEP: Collecting events from namespace "kubectl-7079". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:41:07.861 STEP: Found 5 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:41:07.923 Mar 19 04:41:07.923: INFO: At 2023-03-19 04:40:24 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-7079/httpd to e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:41:07.923: INFO: At 2023-03-19 04:40:24 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine Mar 19 04:41:07.923: INFO: At 2023-03-19 04:40:24 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Created: Created container httpd Mar 19 04:41:07.923: INFO: At 2023-03-19 04:40:24 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Started: Started container httpd Mar 19 04:41:07.923: INFO: At 2023-03-19 04:41:07 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Killing: Stopping container httpd Mar 19 04:41:07.997: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:41:07.997: INFO: Mar 19 04:41:08.054: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:41:08.135: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 28195 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:40:10 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:41:08.135: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:41:08.219: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:41:08.306: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.306: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:41:08.306: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.306: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:41:08.306: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.306: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:41:08.306: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:41:08.306: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:41:08.306: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:41:08.306: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.306: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:41:08.306: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.306: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:41:08.306: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.306: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:41:08.306: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.306: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:41:08.306: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.306: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:41:08.586: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:41:08.586: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:41:08.652: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 29912 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-4988":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:38:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:40:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:40:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:40:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-4988^31ba3294-c610-11ed-a570-aaf4fc77776f],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-4988^31ba3294-c610-11ed-a570-aaf4fc77776f,DevicePath:,},},Config:nil,},} Mar 19 04:41:08.652: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:41:08.724: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:41:08.898: INFO: up-down-2-hl7bg started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:41:08.898: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:41:08.898: INFO: up-down-3-6s7dl started at 2023-03-19 04:39:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container up-down-3 ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-hq8q8 started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: test-host-network-pod started at 2023-03-19 04:40:25 +0000 UTC (0+2 container statuses recorded) Mar 19 04:41:08.898: INFO: Container busybox-1 ready: true, restart count 0 Mar 19 04:41:08.898: INFO: Container busybox-2 ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-hjkqq started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-rcc57 started at 2023-03-19 04:41:07 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container agnhost-container ready: false, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-24vxm started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-5vql5 started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: netserver-0 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:08.898: INFO: test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:08.898: INFO: pod-9aff77f0-54d6-4426-bb78-5d054748384a started at 2023-03-19 04:39:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-47bt9 started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: hostpath-injector started at 2023-03-19 04:40:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container hostpath-injector ready: true, restart count 0 Mar 19 04:41:08.898: INFO: netserver-0 started at 2023-03-19 04:40:47 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:08.898: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:41:08.898: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-qhgbf started at 2023-03-19 04:40:27 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:41:08.898: INFO: pause-pod-1 started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:41:08.898: INFO: concurrent-27986681-6tvt7 started at 2023-03-19 04:41:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container c ready: true, restart count 0 Mar 19 04:41:08.898: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:41:08.898: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:41:08.898: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-j2k47 started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-7cf5x started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: pod-projected-secrets-f9cab974-964d-4c0a-ae03-86a56fa11b0b started at 2023-03-19 04:40:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container projected-secret-volume-test ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-jwqcv started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:40:34 +0000 UTC (0+7 container statuses recorded) Mar 19 04:41:08.898: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:41:08.898: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:41:08.898: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:41:08.898: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:41:08.898: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:41:08.898: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:41:08.898: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-d4vph started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-7t9fx started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-l426b started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-5blz7 started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-d9mgc started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:41:08.898: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:41:08.898: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:41:08.898: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:41:08.898: INFO: netserver-0 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:08.898: INFO: forbid-27986681-k4676 started at 2023-03-19 04:41:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container c ready: true, restart count 0 Mar 19 04:41:08.898: INFO: test-pod started at 2023-03-19 04:40:21 +0000 UTC (0+3 container statuses recorded) Mar 19 04:41:08.898: INFO: Container busybox-1 ready: true, restart count 0 Mar 19 04:41:08.898: INFO: Container busybox-2 ready: true, restart count 0 Mar 19 04:41:08.898: INFO: Container busybox-3 ready: true, restart count 0 Mar 19 04:41:08.898: INFO: pod-client started at 2023-03-19 04:40:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container pod-client ready: true, restart count 0 Mar 19 04:41:08.898: INFO: host-test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-k2lv9 started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: security-context-999c0c86-6cab-4f8a-a742-ecb26e0f2bc4 started at 2023-03-19 04:41:07 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container test-container ready: false, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-44txz started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: startup-7dd2f0a5-f5bb-4896-be76-c76188edd607 started at 2023-03-19 04:40:20 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container busybox ready: false, restart count 0 Mar 19 04:41:08.898: INFO: netserver-0 started at 2023-03-19 04:39:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:08.898: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-88tg8 started at 2023-03-19 04:41:04 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container agnhost-container ready: false, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-kvzj8 started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container httpd ready: true, restart count 0 Mar 19 04:41:08.898: INFO: simpletest-rc-to-be-deleted-fx42h started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:08.898: INFO: test-container-pod started at 2023-03-19 04:40:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:08.898: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:09.868: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:41:09.868: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:41:09.921: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 29247 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-fsgroup-policy-612":"e2e-c595d7501c-674b9-minion-group-kd0v"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:38:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:39:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-19 04:40:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:39:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:41:09.921: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:41:09.969: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:41:10.082: INFO: netserver-1 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:10.082: INFO: csi-mockplugin-0 started at 2023-03-19 04:40:32 +0000 UTC (0+3 container statuses recorded) Mar 19 04:41:10.082: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:41:10.082: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:41:10.082: INFO: Container mock ready: true, restart count 0 Mar 19 04:41:10.082: INFO: pvc-volume-tester-fsbh4 started at 2023-03-19 04:40:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container volume-tester ready: true, restart count 0 Mar 19 04:41:10.082: INFO: simpletest-rc-to-be-deleted-fsb8w started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:10.082: INFO: up-down-3-kgjpb started at 2023-03-19 04:39:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container up-down-3 ready: true, restart count 0 Mar 19 04:41:10.082: INFO: netserver-1 started at 2023-03-19 04:39:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:10.082: INFO: test-container-pod started at 2023-03-19 04:40:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:10.082: INFO: execpodrhc6f started at 2023-03-19 04:39:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:41:10.082: INFO: metadata-proxy-v0.1-bxcx5 started at 2023-03-19 04:28:34 +0000 UTC (0+2 container statuses recorded) Mar 19 04:41:10.082: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:41:10.082: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:41:10.082: INFO: test-grpc-0b6aa968-1734-475e-8787-92e57c84a6b9 started at 2023-03-19 04:37:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:41:10.082: INFO: simpletest-rc-to-be-deleted-gc29q started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:10.082: INFO: simpletest-rc-to-be-deleted-hrxc2 started at 2023-03-19 04:40:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:10.082: INFO: konnectivity-agent-n8mzc started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:41:10.082: INFO: simpletest-rc-to-be-deleted-ls4kl started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:10.082: INFO: simpletest-rc-to-be-deleted-jhtlv started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:10.082: INFO: netserver-1 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:10.082: INFO: external-provisioner-qkr6s started at 2023-03-19 04:40:21 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:41:10.082: INFO: up-down-2-xg9nt started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:41:10.082: INFO: simpletest-rc-to-be-deleted-8nb9v started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:10.082: INFO: coredns-8f5847b64-rzgwn started at 2023-03-19 04:28:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container coredns ready: true, restart count 0 Mar 19 04:41:10.082: INFO: simpletest-rc-to-be-deleted-6cwbg started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:10.082: INFO: agnhost-primary-62g4j started at 2023-03-19 04:39:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container agnhost-primary ready: false, restart count 0 Mar 19 04:41:10.082: INFO: simpletest-rc-to-be-deleted-6d9f9 started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:10.082: INFO: simpletest-rc-to-be-deleted-9pnzh started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:10.082: INFO: simpletest-rc-to-be-deleted-bbgb8 started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:10.082: INFO: simpletest-rc-to-be-deleted-6sbhw started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:10.082: INFO: rs-p2zgq started at 2023-03-19 04:40:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container donothing ready: false, restart count 0 Mar 19 04:41:10.082: INFO: pod1 started at 2023-03-19 04:39:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:41:10.082: INFO: pod-8a203448-942a-4b96-ada5-00f645504065 started at 2023-03-19 04:40:22 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:41:10.082: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-kd0v started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:41:10.082: INFO: netserver-1 started at 2023-03-19 04:40:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:10.082: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-bjb9m started at 2023-03-19 04:40:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:41:10.082: INFO: npd-v0.8.9-xn47l started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:41:10.082: INFO: csi-mockplugin-0 started at 2023-03-19 04:40:03 +0000 UTC (0+4 container statuses recorded) Mar 19 04:41:10.082: INFO: Container busybox ready: true, restart count 0 Mar 19 04:41:10.082: INFO: Container csi-provisioner ready: true, restart count 2 Mar 19 04:41:10.082: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:41:10.082: INFO: Container mock ready: true, restart count 0 Mar 19 04:41:10.082: INFO: inline-volume-tester2-bdwxn started at 2023-03-19 04:37:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:41:10.082: INFO: webserver-pod started at 2023-03-19 04:40:47 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:10.082: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:41:10.668: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:41:10.668: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:41:10.755: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-rx1t 81031ff0-6ac7-4503-8384-dada37cf30f8 30310 0 2023-03-19 04:28:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-rx1t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-rx1t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-capacity-6426":"csi-mock-csi-mock-volumes-capacity-6426"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2023-03-19 04:38:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:39:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-19 04:41:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-rx1t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:39:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.10.228,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:515db57784a9c6bd89ce17868c72021b,SystemUUID:515db577-84a9-c6bd-89ce-17868c72021b,BootID:744f3d9d-8dea-4311-872e-96785d8e8169,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:41:10.755: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:41:10.806: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:41:11.045: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:40:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container csi-attacher ready: true, restart count 2 Mar 19 04:41:11.045: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:40:03 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container csi-resizer ready: true, restart count 2 Mar 19 04:41:11.045: INFO: volume-snapshot-controller-0 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container volume-snapshot-controller ready: true, restart count 0 Mar 19 04:41:11.045: INFO: pause-pod-1 started at 2023-03-19 04:40:36 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:41:11.045: INFO: simpletest-rc-to-be-deleted-ckpqb started at 2023-03-19 04:40:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.045: INFO: simpletest-rc-to-be-deleted-grmx8 started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.045: INFO: private started at 2023-03-19 04:40:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container cntr ready: true, restart count 0 Mar 19 04:41:11.045: INFO: inline-volume-tester-v4fqb started at 2023-03-19 04:40:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:41:11.045: INFO: simpletest-rc-to-be-deleted-dzzp6 started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.045: INFO: metadata-proxy-v0.1-tlkct started at 2023-03-19 04:28:35 +0000 UTC (0+2 container statuses recorded) Mar 19 04:41:11.045: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:41:11.045: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:41:11.045: INFO: csi-mockplugin-0 started at 2023-03-19 04:35:59 +0000 UTC (0+4 container statuses recorded) Mar 19 04:41:11.045: INFO: Container busybox ready: true, restart count 0 Mar 19 04:41:11.045: INFO: Container csi-provisioner ready: false, restart count 5 Mar 19 04:41:11.045: INFO: Container driver-registrar ready: true, restart count 2 Mar 19 04:41:11.045: INFO: Container mock ready: true, restart count 0 Mar 19 04:41:11.045: INFO: konnectivity-agent-m2cxq started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:41:11.045: INFO: coredns-8f5847b64-cb89d started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container coredns ready: true, restart count 0 Mar 19 04:41:11.045: INFO: l7-default-backend-856d874f49-9wsfv started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container default-http-backend ready: true, restart count 0 Mar 19 04:41:11.045: INFO: netserver-2 started at 2023-03-19 04:40:48 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:11.045: INFO: simpletest-rc-to-be-deleted-b8kwn started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.045: INFO: up-down-2-kxbkc started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container up-down-2 ready: false, restart count 0 Mar 19 04:41:11.045: INFO: simpletest-rc-to-be-deleted-lh82c started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.045: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-rx1t-zgflg started at 2023-03-19 04:41:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:41:11.045: INFO: simpletest-rc-to-be-deleted-j5cxm started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.045: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.046: INFO: up-down-3-kcln4 started at 2023-03-19 04:39:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container up-down-3 ready: true, restart count 0 Mar 19 04:41:11.046: INFO: netserver-2 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:11.046: INFO: test-container-pod started at 2023-03-19 04:39:59 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:11.046: INFO: slave started at 2023-03-19 04:40:13 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container cntr ready: true, restart count 0 Mar 19 04:41:11.046: INFO: csi-mockplugin-0 started at 2023-03-19 04:40:03 +0000 UTC (0+4 container statuses recorded) Mar 19 04:41:11.046: INFO: Container busybox ready: true, restart count 0 Mar 19 04:41:11.046: INFO: Container csi-provisioner ready: true, restart count 2 Mar 19 04:41:11.046: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:41:11.046: INFO: Container mock ready: true, restart count 0 Mar 19 04:41:11.046: INFO: simpletest-rc-to-be-deleted-c6vzv started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.046: INFO: ss-0 started at 2023-03-19 04:41:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container webserver ready: false, restart count 0 Mar 19 04:41:11.046: INFO: simpletest-rc-to-be-deleted-jd9cq started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.046: INFO: netserver-2 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:11.046: INFO: netserver-2 started at 2023-03-19 04:39:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container webserver ready: true, restart count 0 Mar 19 04:41:11.046: INFO: master started at 2023-03-19 04:40:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container cntr ready: true, restart count 0 Mar 19 04:41:11.046: INFO: simpletest-rc-to-be-deleted-l425s started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.046: INFO: kube-dns-autoscaler-7b444c59c9-28g2s started at 2023-03-19 04:31:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container autoscaler ready: true, restart count 0 Mar 19 04:41:11.046: INFO: pod-server-1 started at 2023-03-19 04:40:33 +0000 UTC (1+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Init container init ready: true, restart count 0 Mar 19 04:41:11.046: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:41:11.046: INFO: simpletest-rc-to-be-deleted-9655t started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.046: INFO: npd-v0.8.9-j2c8h started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:41:11.046: INFO: default started at 2023-03-19 04:40:17 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container cntr ready: true, restart count 0 Mar 19 04:41:11.046: INFO: simpletest-rc-to-be-deleted-kps2r started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.046: INFO: simpletest-rc-to-be-deleted-kwbw2 started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container nginx ready: true, restart count 0 Mar 19 04:41:11.046: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-rx1t started at 2023-03-19 04:28:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:41:11.046: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:41:11.575: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-rx1t END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:41:11.575 (3.715s) < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - dump namespaces | framework.go:209 @ 03/19/23 04:41:11.575 (3.715s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - tear down framework | framework.go:206 @ 03/19/23 04:41:11.575 STEP: Destroying namespace "kubectl-7079" for this suite. - test/e2e/framework/framework.go:351 @ 03/19/23 04:41:11.575 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - tear down framework | framework.go:206 @ 03/19/23 04:41:11.658 (83ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:41:11.659 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:41:11.659 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\sreturn\scommand\sexit\scodes\sshould\ssupport\sport\-forward$'
[FAILED] Failed to read from kubectl port-forward stdout: EOF In [It] at: test/e2e/kubectl/portforward.go:191 @ 03/19/23 04:39:11.451from junit_01.xml
> Enter [BeforeEach] [sig-cli] Kubectl client - set up framework | framework.go:191 @ 03/19/23 04:38:26.612 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/19/23 04:38:26.612 Mar 19 04:38:26.612: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename kubectl - test/e2e/framework/framework.go:250 @ 03/19/23 04:38:26.613 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/19/23 04:38:26.744 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/19/23 04:38:26.837 < Exit [BeforeEach] [sig-cli] Kubectl client - set up framework | framework.go:191 @ 03/19/23 04:38:26.918 (307ms) > Enter [BeforeEach] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:38:26.918 < Exit [BeforeEach] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:38:26.919 (0s) > Enter [BeforeEach] [sig-cli] Kubectl client - test/e2e/kubectl/kubectl.go:276 @ 03/19/23 04:38:26.919 < Exit [BeforeEach] [sig-cli] Kubectl client - test/e2e/kubectl/kubectl.go:276 @ 03/19/23 04:38:26.919 (0s) > Enter [BeforeEach] Simple pod - test/e2e/kubectl/kubectl.go:413 @ 03/19/23 04:38:26.919 STEP: creating the pod from apiVersion: v1 kind: Pod metadata: name: httpd labels: name: httpd spec: containers: - name: httpd image: registry.k8s.io/e2e-test-images/httpd:2.4.38-4 ports: - containerPort: 80 readinessProbe: httpGet: path: / port: 80 initialDelaySeconds: 5 timeoutSeconds: 5 - test/e2e/kubectl/kubectl.go:414 @ 03/19/23 04:38:26.919 Mar 19 04:38:26.919: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-2498 create -f -' Mar 19 04:38:28.652: INFO: stderr: "" Mar 19 04:38:28.652: INFO: stdout: "pod/httpd created\n" < Exit [BeforeEach] Simple pod - test/e2e/kubectl/kubectl.go:413 @ 03/19/23 04:38:41.021 (14.103s) > Enter [It] should support port-forward - test/e2e/kubectl/kubectl.go:550 @ 03/19/23 04:38:41.021 STEP: forwarding the container port to a local port - test/e2e/kubectl/kubectl.go:551 @ 03/19/23 04:38:41.021 Mar 19 04:38:41.021: INFO: starting port-forward command and streaming output Mar 19 04:38:41.021: INFO: Asynchronously running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-2498 port-forward --namespace=kubectl-2498 httpd :80' Mar 19 04:38:41.022: INFO: reading from `kubectl port-forward` command's stdout [FAILED] Failed to read from kubectl port-forward stdout: EOF In [It] at: test/e2e/kubectl/portforward.go:191 @ 03/19/23 04:39:11.451 < Exit [It] should support port-forward - test/e2e/kubectl/kubectl.go:550 @ 03/19/23 04:39:11.451 (30.43s) > Enter [AfterEach] Simple pod - test/e2e/kubectl/kubectl.go:419 @ 03/19/23 04:39:11.452 STEP: using delete to clean up resources - test/e2e/kubectl/kubectl.go:200 @ 03/19/23 04:39:11.452 Mar 19 04:39:11.452: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-2498 delete --grace-period=0 --force -f -' Mar 19 04:39:12.197: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Mar 19 04:39:12.197: INFO: stdout: "pod \"httpd\" force deleted\n" Mar 19 04:39:12.197: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-2498 get rc,svc -l name=httpd --no-headers' Mar 19 04:39:12.544: INFO: stderr: "No resources found in kubectl-2498 namespace.\n" Mar 19 04:39:12.544: INFO: stdout: "" Mar 19 04:39:12.544: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-2498 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Mar 19 04:39:12.816: INFO: stderr: "" Mar 19 04:39:12.816: INFO: stdout: "" < Exit [AfterEach] Simple pod - test/e2e/kubectl/kubectl.go:419 @ 03/19/23 04:39:12.816 (1.365s) > Enter [AfterEach] [sig-cli] Kubectl client - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:39:12.816 Mar 19 04:39:12.816: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cli] Kubectl client - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:39:13.037 (221ms) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:39:13.037 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:39:13.037 (0s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - dump namespaces | framework.go:209 @ 03/19/23 04:39:13.037 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:39:13.037 STEP: Collecting events from namespace "kubectl-2498". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:39:13.037 STEP: Found 5 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:39:13.178 Mar 19 04:39:13.178: INFO: At 2023-03-19 04:38:28 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-2498/httpd to e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:39:13.178: INFO: At 2023-03-19 04:38:29 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine Mar 19 04:39:13.178: INFO: At 2023-03-19 04:38:29 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Created: Created container httpd Mar 19 04:39:13.178: INFO: At 2023-03-19 04:38:29 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Started: Started container httpd Mar 19 04:39:13.178: INFO: At 2023-03-19 04:39:11 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-rx1t} Killing: Stopping container httpd Mar 19 04:39:13.342: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:39:13.342: INFO: Mar 19 04:39:13.507: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:39:13.649: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 15766 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:35:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:35:04 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:39:13.649: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:39:13.821: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:39:13.972: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:13.972: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:39:13.972: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:13.972: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:39:13.972: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:13.972: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:39:13.972: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:13.972: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:39:13.972: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:13.972: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:39:13.972: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:13.972: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:39:13.972: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:13.972: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:39:13.972: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:13.972: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:39:13.972: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:39:13.972: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:39:13.972: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:39:14.335: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:39:14.335: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:39:14.447: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 24955 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-2276":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-03-19 04:38:24 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:38:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {node-problem-detector Update v1 2023-03-19 04:38:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:28 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:28 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:28 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:38:28 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2276^e0c98dd6-c60f-11ed-941d-b610f14ee05e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2276^e0c98dd6-c60f-11ed-941d-b610f14ee05e,DevicePath:,},},Config:nil,},} Mar 19 04:39:14.447: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:39:14.596: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:39:14.808: INFO: pvc-volume-tester-4c68t started at 2023-03-19 04:38:23 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container volume-tester ready: true, restart count 0 Mar 19 04:39:14.808: INFO: pod-disruption-failure-ignore-2-x6bxb started at 2023-03-19 04:38:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container c ready: false, restart count 0 Mar 19 04:39:14.808: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:39:14.808: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:39:14.808: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:39:14.808: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:39:14.808: INFO: csi-mockplugin-0 started at 2023-03-19 04:38:16 +0000 UTC (0+3 container statuses recorded) Mar 19 04:39:14.808: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:39:14.808: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:39:14.808: INFO: Container mock ready: true, restart count 0 Mar 19 04:39:14.808: INFO: pod-disruption-failure-ignore-3-m6j9p started at 2023-03-19 04:38:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container c ready: false, restart count 0 Mar 19 04:39:14.808: INFO: pod-disruption-failure-ignore-0-wm4v6 started at 2023-03-19 04:39:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container c ready: false, restart count 0 Mar 19 04:39:14.808: INFO: csi-mockplugin-attacher-0 started at 2023-03-19 04:38:16 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:39:14.808: INFO: host-test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:39:14.808: INFO: ss2-1 started at 2023-03-19 04:37:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container webserver ready: false, restart count 0 Mar 19 04:39:14.808: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container httpd ready: true, restart count 0 Mar 19 04:39:14.808: INFO: pod-subpath-test-configmap-t9gf started at 2023-03-19 04:39:01 +0000 UTC (1+2 container statuses recorded) Mar 19 04:39:14.808: INFO: Init container init-volume-configmap-t9gf ready: true, restart count 0 Mar 19 04:39:14.808: INFO: Container test-container-subpath-configmap-t9gf ready: true, restart count 0 Mar 19 04:39:14.808: INFO: Container test-container-volume-configmap-t9gf ready: true, restart count 0 Mar 19 04:39:14.808: INFO: update-demo-nautilus-9kjwx started at 2023-03-19 04:39:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container update-demo ready: true, restart count 0 Mar 19 04:39:14.808: INFO: up-down-2-hl7bg started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:39:14.808: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:39:14.808: INFO: pod-handle-http-request started at 2023-03-19 04:39:11 +0000 UTC (0+2 container statuses recorded) Mar 19 04:39:14.808: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 19 04:39:14.808: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 19 04:39:14.808: INFO: test-webserver-92bef116-fc7a-4dc1-91c0-556f7cb58af5 started at 2023-03-19 04:35:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container test-webserver ready: true, restart count 0 Mar 19 04:39:14.808: INFO: netserver-0 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container webserver ready: true, restart count 0 Mar 19 04:39:14.808: INFO: execpod-evictedpodsnxzl8 started at 2023-03-19 04:38:55 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:39:14.808: INFO: netserver-0 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container webserver ready: true, restart count 0 Mar 19 04:39:14.808: INFO: test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container webserver ready: true, restart count 0 Mar 19 04:39:14.808: INFO: csi-mockplugin-resizer-0 started at 2023-03-19 04:38:16 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:39:14.808: INFO: webserver-67bd4bf6dc-p9z66 started at 2023-03-19 04:38:54 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container httpd ready: true, restart count 0 Mar 19 04:39:14.808: INFO: alpine-nnp-true-9ad27f96-3c3c-4106-8016-972c648aca81 started at 2023-03-19 04:39:05 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container alpine-nnp-true-9ad27f96-3c3c-4106-8016-972c648aca81 ready: false, restart count 0 Mar 19 04:39:14.808: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:39:14.808: INFO: alpine-nnp-false-63a446b2-beea-414c-bdd3-6e95d9f57ce1 started at 2023-03-19 04:39:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container alpine-nnp-false-63a446b2-beea-414c-bdd3-6e95d9f57ce1 ready: false, restart count 0 Mar 19 04:39:14.808: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-l6wkq started at 2023-03-19 04:38:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:39:14.808: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:39:14.808: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:39:14.808: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:39:14.808: INFO: pod-disruption-failure-ignore-1-5zddv started at 2023-03-19 04:38:44 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container c ready: false, restart count 0 Mar 19 04:39:14.808: INFO: pod-disruption-failure-ignore-0-m42nm started at 2023-03-19 04:38:44 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:14.808: INFO: Container c ready: true, restart count 0 Mar 19 04:39:15.268: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:39:15.268: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:39:15.452: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 25741 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9888":"e2e-c595d7501c-674b9-minion-group-kd0v"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:38:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:39:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:39:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:39:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-9888^f9d4c1da-c60f-11ed-836e-aab94f4bef3c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-9888^f9d4c1da-c60f-11ed-836e-aab94f4bef3c,DevicePath:,},},Config:nil,},} Mar 19 04:39:15.452: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:39:15.565: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:39:15.809: INFO: sample-apiserver-deployment-6dfd6dfd5b-54rbk started at 2023-03-19 04:39:13 +0000 UTC (0+2 container statuses recorded) Mar 19 04:39:15.809: INFO: Container etcd ready: false, restart count 0 Mar 19 04:39:15.809: INFO: Container sample-apiserver ready: false, restart count 0 Mar 19 04:39:15.809: INFO: up-down-2-xg9nt started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:39:15.809: INFO: coredns-8f5847b64-rzgwn started at 2023-03-19 04:28:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container coredns ready: true, restart count 0 Mar 19 04:39:15.809: INFO: update-demo-nautilus-g2wt4 started at 2023-03-19 04:39:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container update-demo ready: false, restart count 0 Mar 19 04:39:15.809: INFO: netserver-1 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container webserver ready: true, restart count 0 Mar 19 04:39:15.809: INFO: test-container-pod started at 2023-03-19 04:36:18 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container webserver ready: true, restart count 0 Mar 19 04:39:15.809: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-kd0v started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:39:15.809: INFO: ss2-0 started at 2023-03-19 04:37:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container webserver ready: true, restart count 0 Mar 19 04:39:15.809: INFO: verify-service-up-host-exec-pod started at 2023-03-19 04:37:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:39:15.809: INFO: npd-v0.8.9-xn47l started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:39:15.809: INFO: concurrent-27986679-6ln84 started at 2023-03-19 04:39:00 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container c ready: true, restart count 0 Mar 19 04:39:15.809: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-kd0v-mcq5k started at 2023-03-19 04:39:14 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container agnhost-container ready: false, restart count 0 Mar 19 04:39:15.809: INFO: inline-volume-tester2-bdwxn started at 2023-03-19 04:37:15 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 19 04:39:15.809: INFO: inline-volume-tester-fbgf7 started at 2023-03-19 04:39:04 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 19 04:39:15.809: INFO: netserver-1 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container webserver ready: true, restart count 0 Mar 19 04:39:15.809: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:39:01 +0000 UTC (0+7 container statuses recorded) Mar 19 04:39:15.809: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:39:15.809: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:39:15.809: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:39:15.809: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:39:15.809: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:39:15.809: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:39:15.809: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:39:15.809: INFO: metadata-proxy-v0.1-bxcx5 started at 2023-03-19 04:28:34 +0000 UTC (0+2 container statuses recorded) Mar 19 04:39:15.809: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:39:15.809: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:39:15.809: INFO: konnectivity-agent-n8mzc started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:39:15.809: INFO: verify-service-up-exec-pod-znpd4 started at 2023-03-19 04:37:40 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:39:15.809: INFO: test-grpc-0b6aa968-1734-475e-8787-92e57c84a6b9 started at 2023-03-19 04:37:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:15.809: INFO: Container agnhost ready: true, restart count 0 Mar 19 04:39:16.749: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:39:16.749: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:39:16.841: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-rx1t 81031ff0-6ac7-4503-8384-dada37cf30f8 25436 0 2023-03-19 04:28:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-rx1t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-rx1t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:38:19 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-19 04:38:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2023-03-19 04:38:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-rx1t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:59 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:50 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:50 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:38:50 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:38:50 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:34.168.10.228,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-rx1t.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:515db57784a9c6bd89ce17868c72021b,SystemUUID:515db577-84a9-c6bd-89ce-17868c72021b,BootID:744f3d9d-8dea-4311-872e-96785d8e8169,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:39:16.841: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:39:16.910: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-rx1t Mar 19 04:39:17.063: INFO: kube-dns-autoscaler-7b444c59c9-28g2s started at 2023-03-19 04:31:25 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container autoscaler ready: true, restart count 0 Mar 19 04:39:17.063: INFO: netserver-2 started at 2023-03-19 04:35:57 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container webserver ready: true, restart count 0 Mar 19 04:39:17.063: INFO: npd-v0.8.9-j2c8h started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:39:17.063: INFO: pod-secrets-8dc0202d-cdba-45be-874f-67cde42c5d8f started at 2023-03-19 04:38:37 +0000 UTC (0+3 container statuses recorded) Mar 19 04:39:17.063: INFO: Container creates-volume-test ready: true, restart count 0 Mar 19 04:39:17.063: INFO: Container dels-volume-test ready: true, restart count 0 Mar 19 04:39:17.063: INFO: Container upds-volume-test ready: true, restart count 0 Mar 19 04:39:17.063: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-rx1t started at 2023-03-19 04:28:34 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:39:17.063: INFO: dns-test-dab99f74-bbd4-486e-aafc-df570b1dfcfd started at 2023-03-19 04:39:03 +0000 UTC (0+3 container statuses recorded) Mar 19 04:39:17.063: INFO: Container jessie-querier ready: true, restart count 0 Mar 19 04:39:17.063: INFO: Container querier ready: true, restart count 0 Mar 19 04:39:17.063: INFO: Container webserver ready: true, restart count 0 Mar 19 04:39:17.063: INFO: volume-snapshot-controller-0 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container volume-snapshot-controller ready: true, restart count 0 Mar 19 04:39:17.063: INFO: external-provisioner-bsgn7 started at 2023-03-19 04:39:14 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container nfs-provisioner ready: true, restart count 0 Mar 19 04:39:17.063: INFO: pod-subpath-test-configmap-kghj started at 2023-03-19 04:39:06 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container test-container-subpath-configmap-kghj ready: true, restart count 0 Mar 19 04:39:17.063: INFO: metadata-proxy-v0.1-tlkct started at 2023-03-19 04:28:35 +0000 UTC (0+2 container statuses recorded) Mar 19 04:39:17.063: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:39:17.063: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:39:17.063: INFO: csi-mockplugin-0 started at 2023-03-19 04:35:59 +0000 UTC (0+4 container statuses recorded) Mar 19 04:39:17.063: INFO: Container busybox ready: true, restart count 0 Mar 19 04:39:17.063: INFO: Container csi-provisioner ready: false, restart count 4 Mar 19 04:39:17.063: INFO: Container driver-registrar ready: true, restart count 0 Mar 19 04:39:17.063: INFO: Container mock ready: true, restart count 0 Mar 19 04:39:17.063: INFO: pod-projected-configmaps-ea8bafd1-ce7e-4397-b51f-df79a6414d7f started at 2023-03-19 04:39:07 +0000 UTC (0+3 container statuses recorded) Mar 19 04:39:17.063: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 19 04:39:17.063: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 19 04:39:17.063: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 19 04:39:17.063: INFO: coredns-8f5847b64-cb89d started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container coredns ready: true, restart count 0 Mar 19 04:39:17.063: INFO: l7-default-backend-856d874f49-9wsfv started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container default-http-backend ready: true, restart count 0 Mar 19 04:39:17.063: INFO: konnectivity-agent-m2cxq started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:39:17.063: INFO: up-down-2-kxbkc started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:39:17.063: INFO: evicted-pod started at 2023-03-19 04:38:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container evicted-pod ready: false, restart count 1 Mar 19 04:39:17.063: INFO: netserver-2 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container webserver ready: true, restart count 0 Mar 19 04:39:17.063: INFO: ss2-2 started at 2023-03-19 04:37:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:39:17.063: INFO: Container webserver ready: true, restart count 0 Mar 19 04:39:17.511: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-rx1t END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:39:17.511 (4.474s) < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - dump namespaces | framework.go:209 @ 03/19/23 04:39:17.511 (4.474s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - tear down framework | framework.go:206 @ 03/19/23 04:39:17.511 STEP: Destroying namespace "kubectl-2498" for this suite. - test/e2e/framework/framework.go:351 @ 03/19/23 04:39:17.511 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - tear down framework | framework.go:206 @ 03/19/23 04:39:17.725 (214ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:39:17.725 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/19/23 04:39:17.725 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\ssupport\sexec$'
[FAILED] error running /go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-6882 exec -i --pod-running-timeout=2m0s httpd -- cat: Command stdout: stderr: Error from server: error dialing backend: dial timeout, backstop error: exit status 1 In [It] at: test/e2e/framework/kubectl/builder.go:87 @ 03/19/23 04:40:54.583
> Enter [BeforeEach] [sig-cli] Kubectl client - set up framework | framework.go:191 @ 03/19/23 04:40:08.749 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/19/23 04:40:08.749 Mar 19 04:40:08.749: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename kubectl - test/e2e/framework/framework.go:250 @ 03/19/23 04:40:08.75 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/19/23 04:40:08.899 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/19/23 04:40:08.99 < Exit [BeforeEach] [sig-cli] Kubectl client - set up framework | framework.go:191 @ 03/19/23 04:40:09.091 (343ms) > Enter [BeforeEach] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:40:09.091 < Exit [BeforeEach] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:33 @ 03/19/23 04:40:09.091 (0s) > Enter [BeforeEach] [sig-cli] Kubectl client - test/e2e/kubectl/kubectl.go:276 @ 03/19/23 04:40:09.091 < Exit [BeforeEach] [sig-cli] Kubectl client - test/e2e/kubectl/kubectl.go:276 @ 03/19/23 04:40:09.092 (0s) > Enter [BeforeEach] Simple pod - test/e2e/kubectl/kubectl.go:413 @ 03/19/23 04:40:09.092 STEP: creating the pod from - test/e2e/kubectl/kubectl.go:414 @ 03/19/23 04:40:09.092 Mar 19 04:40:09.092: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-6882 create -f -' Mar 19 04:40:09.819: INFO: stderr: "" Mar 19 04:40:09.819: INFO: stdout: "pod/httpd created\n" < Exit [BeforeEach] Simple pod - test/e2e/kubectl/kubectl.go:413 @ 03/19/23 04:40:22.367 (13.276s) > Enter [It] should support exec - test/e2e/kubectl/kubectl.go:423 @ 03/19/23 04:40:22.367 STEP: executing a command in the container - test/e2e/kubectl/kubectl.go:424 @ 03/19/23 04:40:22.367 Mar 19 04:40:22.367: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-6882 exec --pod-running-timeout=2m0s httpd -- echo running in container' Mar 19 04:40:23.418: INFO: stderr: "" Mar 19 04:40:23.418: INFO: stdout: "running in container\n" STEP: executing a very long command in the container - test/e2e/kubectl/kubectl.go:430 @ 03/19/23 04:40:23.418 Mar 19 04:40:23.418: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-6882 exec --pod-running-timeout=2m0s httpd -- echo aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Mar 19 04:40:24.199: INFO: stderr: "" Mar 19 04:40:24.199: INFO: stdout: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa\n" STEP: executing a command in the container with noninteractive stdin - test/e2e/kubectl/kubectl.go:438 @ 03/19/23 04:40:24.2 Mar 19 04:40:24.200: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-6882 exec -i --pod-running-timeout=2m0s httpd -- cat' Mar 19 04:40:54.582: INFO: rc: 1 Mar 19 04:40:54.582: INFO: Unexpected error: <exec.CodeExitError>: error running /go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-6882 exec -i --pod-running-timeout=2m0s httpd -- cat: Command stdout: stderr: Error from server: error dialing backend: dial timeout, backstop error: exit status 1 { Err: <*errors.errorString | 0xc00146c2b0>{ s: "error running /go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-6882 exec -i --pod-running-timeout=2m0s httpd -- cat:\nCommand stdout:\n\nstderr:\nError from server: error dialing backend: dial timeout, backstop\n\nerror:\nexit status 1", }, Code: 1, } [FAILED] error running /go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-6882 exec -i --pod-running-timeout=2m0s httpd -- cat: Command stdout: stderr: Error from server: error dialing backend: dial timeout, backstop error: exit status 1 In [It] at: test/e2e/framework/kubectl/builder.go:87 @ 03/19/23 04:40:54.583 < Exit [It] should support exec - test/e2e/kubectl/kubectl.go:423 @ 03/19/23 04:40:54.583 (32.215s) > Enter [AfterEach] Simple pod - test/e2e/kubectl/kubectl.go:419 @ 03/19/23 04:40:54.583 STEP: using delete to clean up resources - test/e2e/kubectl/kubectl.go:200 @ 03/19/23 04:40:54.583 Mar 19 04:40:54.583: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-6882 delete --grace-period=0 --force -f -' Mar 19 04:40:54.966: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Mar 19 04:40:54.966: INFO: stdout: "pod \"httpd\" force deleted\n" Mar 19 04:40:54.966: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-6882 get rc,svc -l name=httpd --no-headers' Mar 19 04:40:55.249: INFO: stderr: "No resources found in kubectl-6882 namespace.\n" Mar 19 04:40:55.249: INFO: stdout: "" Mar 19 04:40:55.249: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://35.247.110.121 --kubeconfig=/workspace/.kube/config --namespace=kubectl-6882 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Mar 19 04:40:55.475: INFO: stderr: "" Mar 19 04:40:55.475: INFO: stdout: "" < Exit [AfterEach] Simple pod - test/e2e/kubectl/kubectl.go:419 @ 03/19/23 04:40:55.475 (892ms) > Enter [AfterEach] [sig-cli] Kubectl client - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:40:55.475 Mar 19 04:40:55.475: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cli] Kubectl client - test/e2e/framework/node/init/init.go:33 @ 03/19/23 04:40:55.583 (109ms) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:40:55.583 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:35 @ 03/19/23 04:40:55.583 (0s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - dump namespaces | framework.go:209 @ 03/19/23 04:40:55.583 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/19/23 04:40:55.583 STEP: Collecting events from namespace "kubectl-6882". - test/e2e/framework/debug/dump.go:42 @ 03/19/23 04:40:55.583 STEP: Found 5 events. - test/e2e/framework/debug/dump.go:46 @ 03/19/23 04:40:55.648 Mar 19 04:40:55.648: INFO: At 2023-03-19 04:40:09 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-6882/httpd to e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:40:55.648: INFO: At 2023-03-19 04:40:10 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine Mar 19 04:40:55.648: INFO: At 2023-03-19 04:40:10 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Created: Created container httpd Mar 19 04:40:55.648: INFO: At 2023-03-19 04:40:10 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Started: Started container httpd Mar 19 04:40:55.648: INFO: At 2023-03-19 04:40:54 +0000 UTC - event for httpd: {kubelet e2e-c595d7501c-674b9-minion-group-kd0v} Killing: Stopping container httpd Mar 19 04:40:55.700: INFO: POD NODE PHASE GRACE CONDITIONS Mar 19 04:40:55.700: INFO: Mar 19 04:40:55.764: INFO: Logging node info for node e2e-c595d7501c-674b9-master Mar 19 04:40:55.813: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-master e86d9076-7c85-4970-a365-6205eab996e4 28195 0 2023-03-19 04:28:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:28:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-19 04:40:10 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20617822208 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3848937472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18556039957 0} {<nil>} 18556039957 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3586793472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:40:10 +0000 UTC,LastTransitionTime:2023-03-19 04:28:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.110.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-master.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c38cdc80f86091260bd5e277e695580b,SystemUUID:c38cdc80-f860-9126-0bd5-e277e695580b,BootID:8fb6d11f-0e74-4792-a5e9-5d865c0ce654,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:121910627,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:113796605,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:59680240,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 19 04:40:55.813: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-master Mar 19 04:40:55.863: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-master Mar 19 04:40:55.933: INFO: konnectivity-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:55.933: INFO: Container konnectivity-server-container ready: true, restart count 0 Mar 19 04:40:55.933: INFO: kube-apiserver-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:55.933: INFO: Container kube-apiserver ready: true, restart count 0 Mar 19 04:40:55.933: INFO: kube-addon-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:09 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:55.933: INFO: Container kube-addon-manager ready: true, restart count 0 Mar 19 04:40:55.933: INFO: l7-lb-controller-e2e-c595d7501c-674b9-master started at 2023-03-19 04:28:10 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:55.933: INFO: Container l7-lb-controller ready: true, restart count 2 Mar 19 04:40:55.933: INFO: etcd-server-events-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:55.933: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:40:55.933: INFO: kube-controller-manager-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:55.933: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 19 04:40:55.933: INFO: kube-scheduler-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:55.933: INFO: Container kube-scheduler ready: true, restart count 0 Mar 19 04:40:55.933: INFO: metadata-proxy-v0.1-4b95k started at 2023-03-19 04:29:17 +0000 UTC (0+2 container statuses recorded) Mar 19 04:40:55.933: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:40:55.933: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:40:55.933: INFO: etcd-server-e2e-c595d7501c-674b9-master started at 2023-03-19 04:27:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:55.933: INFO: Container etcd-container ready: true, restart count 0 Mar 19 04:40:56.183: INFO: Latency metrics for node e2e-c595d7501c-674b9-master Mar 19 04:40:56.183: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:40:56.232: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-gmd9 2f454512-4d0d-4607-bf72-a923ee30dc49 29357 0 2023-03-19 04:28:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-gmd9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-gmd9 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-4988":"e2e-c595d7501c-674b9-minion-group-gmd9","csi-hostpath-volume-8212":"e2e-c595d7501c-674b9-minion-group-gmd9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:38:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:40:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-19 04:40:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-gmd9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:52 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:40:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:40:41 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.127.121.159,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-gmd9.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51a0c5b33badd35462959ef4a28d1c12,SystemUUID:51a0c5b3-3bad-d354-6295-9ef4a28d1c12,BootID:bf6e2ef9-f0c4-4d01-ad0f-56620362655f,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:9b2d9abda017c28b12f84a344f57cd73fbdb6c2bd7dd5bdd5018246ad1093ba6 registry.k8s.io/sig-storage/hostpathplugin:v1.11.0],SizeBytes:18233005,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-4988^31ba3294-c610-11ed-a570-aaf4fc77776f],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-4988^31ba3294-c610-11ed-a570-aaf4fc77776f,DevicePath:,},},Config:nil,},} Mar 19 04:40:56.233: INFO: Logging kubelet events for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:40:56.287: INFO: Logging pods the kubelet thinks is on node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-tp4lm started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: pod-cb08a8e8-37ea-4675-8f0e-4395c4eb7ad7 started at 2023-03-19 04:39:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-jwqcv started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-ssvjj started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:40:34 +0000 UTC (0+7 container statuses recorded) Mar 19 04:40:56.446: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-d4vph started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-7t9fx started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-tpfzp started at 2023-03-19 04:40:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: npd-v0.8.9-6h5n4 started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container node-problem-detector ready: true, restart count 0 Mar 19 04:40:56.446: INFO: metrics-server-v0.5.2-57d47cbf5-mg5bj started at 2023-03-19 04:29:00 +0000 UTC (0+2 container statuses recorded) Mar 19 04:40:56.446: INFO: Container metrics-server ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container metrics-server-nanny ready: true, restart count 0 Mar 19 04:40:56.446: INFO: netserver-0 started at 2023-03-19 04:39:35 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container webserver ready: true, restart count 0 Mar 19 04:40:56.446: INFO: csi-hostpathplugin-0 started at 2023-03-19 04:39:44 +0000 UTC (0+7 container statuses recorded) Mar 19 04:40:56.446: INFO: Container csi-attacher ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container csi-provisioner ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container csi-resizer ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container hostpath ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container liveness-probe ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-l426b started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-5blz7 started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-d9mgc started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: verify-service-up-exec-pod-h282v started at 2023-03-19 04:40:19 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:40:56.446: INFO: test-pod started at 2023-03-19 04:40:21 +0000 UTC (0+3 container statuses recorded) Mar 19 04:40:56.446: INFO: Container busybox-1 ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container busybox-2 ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container busybox-3 ready: true, restart count 0 Mar 19 04:40:56.446: INFO: pod-client started at 2023-03-19 04:40:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container pod-client ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-vqfxq started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: host-test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-k2lv9 started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: startup-7dd2f0a5-f5bb-4896-be76-c76188edd607 started at 2023-03-19 04:40:20 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container busybox ready: false, restart count 0 Mar 19 04:40:56.446: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-7pk7p started at 2023-03-19 04:39:41 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:40:56.446: INFO: netserver-0 started at 2023-03-19 04:39:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container webserver ready: true, restart count 0 Mar 19 04:40:56.446: INFO: verify-service-up-host-exec-pod started at 2023-03-19 04:40:17 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-44txz started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-q4csq started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-kvzj8 started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: httpd started at 2023-03-19 04:35:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container httpd ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-fx42h started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: kube-proxy-e2e-c595d7501c-674b9-minion-group-gmd9 started at 2023-03-19 04:28:33 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container kube-proxy ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-qdgmk started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: up-down-3-6s7dl started at 2023-03-19 04:39:31 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container up-down-3 ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-tglcp started at 2023-03-19 04:40:53 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: up-down-2-hl7bg started at 2023-03-19 04:36:45 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container up-down-2 ready: true, restart count 0 Mar 19 04:40:56.446: INFO: pod-20a6d01a-5b4e-4d4e-a25b-19d21a2843e1 started at 2023-03-19 04:39:42 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:40:56.446: INFO: test-host-network-pod started at 2023-03-19 04:40:25 +0000 UTC (0+2 container statuses recorded) Mar 19 04:40:56.446: INFO: Container busybox-1 ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container busybox-2 ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-n7h44 started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-hjkqq started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-hq8q8 started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-z9lr4 started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-tvp2r started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-vgpqz started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: netserver-0 started at 2023-03-19 04:38:29 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container webserver ready: true, restart count 0 Mar 19 04:40:56.446: INFO: test-container-pod started at 2023-03-19 04:38:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container webserver ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-r2p5b started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: pod-9aff77f0-54d6-4426-bb78-5d054748384a started at 2023-03-19 04:39:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container write-pod ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-q6vh4 started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-24vxm started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-5vql5 started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-rzzsp started at 2023-03-19 04:40:52 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: hostpath-injector started at 2023-03-19 04:40:38 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container hostpath-injector ready: true, restart count 0 Mar 19 04:40:56.446: INFO: netserver-0 started at 2023-03-19 04:40:47 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container webserver ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-x2wv9 started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-nsrwc started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-pncps started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-47bt9 started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: konnectivity-agent-f7prg started at 2023-03-19 04:28:46 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container konnectivity-agent ready: true, restart count 0 Mar 19 04:40:56.446: INFO: hostexec-e2e-c595d7501c-674b9-minion-group-gmd9-qhgbf started at 2023-03-19 04:40:27 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container agnhost-container ready: true, restart count 0 Mar 19 04:40:56.446: INFO: pause-pod-1 started at 2023-03-19 04:40:50 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container agnhost-container ready: false, restart count 0 Mar 19 04:40:56.446: INFO: metadata-proxy-v0.1-lk8kq started at 2023-03-19 04:28:33 +0000 UTC (0+2 container statuses recorded) Mar 19 04:40:56.446: INFO: Container metadata-proxy ready: true, restart count 0 Mar 19 04:40:56.446: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-j2k47 started at 2023-03-19 04:40:49 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:56.446: INFO: simpletest-rc-to-be-deleted-7cf5x started at 2023-03-19 04:40:51 +0000 UTC (0+1 container statuses recorded) Mar 19 04:40:56.446: INFO: Container nginx ready: false, restart count 0 Mar 19 04:40:58.981: INFO: Latency metrics for node e2e-c595d7501c-674b9-minion-group-gmd9 Mar 19 04:40:58.981: INFO: Logging node info for node e2e-c595d7501c-674b9-minion-group-kd0v Mar 19 04:40:59.032: INFO: Node Info: &Node{ObjectMeta:{e2e-c595d7501c-674b9-minion-group-kd0v 7246592b-356d-444e-9a8f-b1f2a79d9356 29247 0 2023-03-19 04:28:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c595d7501c-674b9-minion-group-kd0v kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c595d7501c-674b9-minion-group-kd0v topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-fsgroup-policy-612":"e2e-c595d7501c-674b9-minion-group-kd0v"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-19 04:28:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-19 04:28:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2023-03-19 04:38:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-03-19 04:39:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-19 04:40:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-079/us-west1-b/e2e-c595d7501c-674b9-minion-group-kd0v,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103865303040 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7806021632 0} {<nil>} 7623068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93478772582 0} {<nil>} 93478772582 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7543877632 0} {<nil>} 7367068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-03-19 04:38:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:50 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-19 04:28:46 +0000 UTC,LastTransitionTime:2023-03-19 04:28:46 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-19 04:39:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-19 04:39:51 +0000 UTC,LastTransitionTime:2023-03-19 04:28:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:35.197.56.121,},NodeAddress{Type:InternalDNS,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},NodeAddress{Type:Hostname,Address:e2e-c595d7501c-674b9-minion-group-kd0v.c.k8s-infra-e2e-boskos-079.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55833d42bb894dc4f24639c0618f89b9,SystemUUID:55833d42-bb89-4dc4-f246-39c0618f89b9,BootID:5fbaeddd-8cfe-422a-9a8d-e141557a8146,KernelVersion:5.15.0-1013-gcp,OSImage:Ubuntu 22.04 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,KubeProxyVersion:v1.27.0-beta.0.24+a14e71dad7e3b9,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-beta.0.24_a14e71dad7e3b9],SizeBytes:72681314,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:e468dddcd275163a042ab297b2d8c2aca50d5e148d2d22f3b6ba119e2f31fa79 registry.k8s.io/sig-storage/csi-provisioner:v3.4.0],SizeBytes:27427836,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-stora